Apr 08 13:10:00.084156 np0000164309 systemd[1]: Started devstack@neutron-ovn-maintenance-worker.service - Devstack devstack@neutron-ovn-maintenance-worker.service.
Apr 08 13:10:00.412863 np0000164309 neutron-ovn-maintenance-worker[104152]: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:41: EventletDeprecationWarning:
Apr 08 13:10:00.412863 np0000164309 neutron-ovn-maintenance-worker[104152]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 08 13:10:00.412863 np0000164309 neutron-ovn-maintenance-worker[104152]: we strongly recommend against using it for new projects.
Apr 08 13:10:00.412863 np0000164309 neutron-ovn-maintenance-worker[104152]: If you are already using Eventlet, we recommend migrating to a different
Apr 08 13:10:00.412863 np0000164309 neutron-ovn-maintenance-worker[104152]: framework.  For more detail see
Apr 08 13:10:00.412863 np0000164309 neutron-ovn-maintenance-worker[104152]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 08 13:10:00.412863 np0000164309 neutron-ovn-maintenance-worker[104152]:   import eventlet
Apr 08 13:10:01.450971 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.common.config [-] Logging enabled!
Apr 08 13:10:01.451740 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker version 28.1.0.dev91
Apr 08 13:10:01.451740 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=104152) setup_logging /opt/stack/neutron/neutron/common/config.py:124}}
Apr 08 13:10:01.451740 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.server.ovn_maintenance [-] OVN maintenance process starting...
Apr 08 13:10:01.451740 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "plugin-directory" by "neutron_lib.plugins.directory._create_plugin_directory" {{(pid=104152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 13:10:01.451740 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=104152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 13:10:01.451740 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.000s {{(pid=104152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 13:10:01.452124 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "manager" by "neutron.manager.NeutronManager._create_instance" {{(pid=104152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 13:10:01.452124 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=104152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 13:10:01.452124 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.manager [-] Loading core plugin: ml2
Apr 08 13:10:01.715472 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.715665 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.715665 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.716249 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.716325 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.716389 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.750956 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.751079 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.751079 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.757060 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.757167 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.757167 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.898176 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.898248 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.898310 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.898810 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.898878 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.898921 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.955731 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x77a2c086a2a0> agent after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.955731 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x77a2c086a2a0> agent after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.955978 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x77a2c086a340> segment precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.955978 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x77a2c086a3e0> network precommit_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:01.956130 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x77a2c086b600> segment before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.005778 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> network before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.005866 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x77a2c085af20> agent before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.005928 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> network before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.005987 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> port before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006043 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> port before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006125 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> segment precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006180 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> segment precommit_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006236 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> segment after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006295 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> segment after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006358 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> network after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006405 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> network precommit_delete 0, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006464 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> port provisioning_complete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006528 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> rbac-policy before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006635 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> rbac-policy after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006693 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> agent after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006754 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> subnet after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006806 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> subnet precommit_delete 0, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006936 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> rbac-policy before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.006936 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> rbac-policy before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.007028 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> segment_host_mapping after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.007028 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin.delete_agent_notified of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> agent after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.007119 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> rbac-policy before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.007183 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> rbac-policy before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.007239 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77a2c1e56c60>> rbac-policy before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.007769 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=104152) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 08 13:10:02.007851 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=104152) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 08 13:10:02.007851 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=104152) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 08 13:10:02.007953 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=104152) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 08 13:10:02.007953 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=104152) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 08 13:10:02.008040 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=104152) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 08 13:10:02.008277 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'geneve']
Apr 08 13:10:02.008981 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['public']
Apr 08 13:10:02.009687 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Apr 08 13:10:02.010235 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict({'public': [(1, 4094)]})
Apr 08 13:10:02.010323 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'local', 'vlan']
Apr 08 13:10:02.010440 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'local', 'vlan'])
Apr 08 13:10:02.010530 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Project network_types: ['geneve']
Apr 08 13:10:02.010693 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security', 'qos']
Apr 08 13:10:02.011204 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security', 'qos']
Apr 08 13:10:02.011255 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security', 'qos']
Apr 08 13:10:02.011346 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['ovn']
Apr 08 13:10:02.047668 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['ovn']
Apr 08 13:10:02.047828 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['ovn']
Apr 08 13:10:02.047828 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] No mechanism drivers provide segment reachability information for agent scheduling.
Apr 08 13:10:02.048292 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x77a2c098ac30>> floatingip before_response 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.048375 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x77a2c098ac30>> port before_response 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.072139 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Apr 08 13:10:02.072222 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Apr 08 13:10:02.072222 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Apr 08 13:10:02.072330 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 65536)]
Apr 08 13:10:02.117217 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO dbcounter [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Registered counter for database neutron
Apr 08 13:10:02.132335 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 13:10:02.523178 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG dbcounter [-] [104152] Writer thread running {{(pid=104152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 08 13:10:02.703102 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Initializing driver for type 'local'
Apr 08 13:10:02.703281 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Initializing driver for type 'vlan'
Apr 08 13:10:02.816420 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] VlanTypeDriver initialization complete
Apr 08 13:10:02.816420 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Initializing extension driver 'port_security'
Apr 08 13:10:02.816763 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.extensions.port_security [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] PortSecurityExtensionDriver initialization complete
Apr 08 13:10:02.816763 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Initializing extension driver 'qos'
Apr 08 13:10:02.816763 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.plugins.ml2.extensions.qos [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QosExtensionDriver initialization complete {{(pid=104152) initialize /opt/stack/neutron/neutron/plugins/ml2/extensions/qos.py:31}}
Apr 08 13:10:02.816763 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Initializing mechanism driver 'ovn'
Apr 08 13:10:02.817104 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Starting OVNMechanismDriver
Apr 08 13:10:02.818162 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver.pre_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> process before_spawn 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.818322 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver.post_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> process after_init 55550000, True {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.818322 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._add_segment_host_mapping_for_segment of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> segment after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.818535 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver.create_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> segment after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.818535 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver.delete_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> segment after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.818832 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._validate_allowed_address_pairs of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> allowed_address_pair before_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.818832 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._create_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> security_group precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.818832 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._update_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> security_group after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.818832 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._create_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> security_group after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819185 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> security_group precommit_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819185 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> security_group after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819185 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._create_sg_rule_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> security_group_rule precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819185 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> security_group_rule after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819388 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> security_group_rule before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819388 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> address_group after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819388 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> address_group after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819590 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77a2c05a69f0>> address_group after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819590 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.ovn.driver.OVNQosDriver object at 0x77a2bfedc3b0>> qos_plugin after_init 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819780 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNTrunkDriver.register of <neutron.services.trunk.drivers.ovn.trunk_driver.OVNTrunkDriver object at 0x77a2bef34d70>> trunk_plugin after_init 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.819964 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.ovn.driver.OVNDriver object at 0x77a2bef34da0>> logging-plugin after_init 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.820337 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.services.logapi.drivers.ovn.driver [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] OVN logging driver registered
Apr 08 13:10:02.821505 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.plugins.ml2.plugin [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=104152) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Apr 08 13:10:02.821735 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef35070>> port after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.821807 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef35070>> port after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.821906 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef35070>> port after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822083 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f80>> subnet after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822083 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f80>> subnet after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822193 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f80>> subnet after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822193 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f20>> network after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822307 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f20>> network after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822379 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f20>> network after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822437 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34ef0>> security_group after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822494 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34ef0>> security_group after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822556 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34ef0>> security_group after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822680 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f50>> security_group_rule after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822752 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f50>> security_group_rule after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822834 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34f50>> security_group_rule after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822918 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34e60>> address_group after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.822985 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34e60>> address_group after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.823053 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77a2bef34e60>> address_group after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.823139 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ML2 OVO RPC backend initialized. {{(pid=104152) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:117}}
Apr 08 13:10:02.823821 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.quota [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded quota_driver: <neutron.db.quota.driver_nolock.DbQuotaNoLockDriver object at 0x77a2bef34e30>.
Apr 08 13:10:02.823899 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.plugin [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Modular L2 Plugin initialization complete
Apr 08 13:10:02.824017 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading services supported by the core plugin {{(pid=104152) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:170}}
Apr 08 13:10:02.824086 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.plugins.ml2.managers [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Got port-security extension from driver 'port_security'
Apr 08 13:10:02.824329 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading service plugins: ['ovn-router', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=104152) _load_service_plugins /opt/stack/neutron/neutron/manager.py:195}}
Apr 08 13:10:02.824395 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading Plugin: ovn-router
Apr 08 13:10:02.831479 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._delete_router_remove_external_gateways of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77a2bef36720>> router before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.831820 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x77a2c06c3380> port after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.831820 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x77a2c06c3240> port after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.831820 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x77a2c06c32e0> subnet after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.831820 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x77a2c06c3420> subnetpool_address_scope after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832207 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x77a2befc2020> port before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832207 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x77a2befc2020> port after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832207 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77a2bef36720>> port precommit_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832207 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip at 0x77a2c06ab2e0> port before_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832207 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x77a2c06ab240> port before_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832698 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77a2bef36720>> router precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832698 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_create of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77a2bef36720>> router precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832698 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_update of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77a2bef36720>> router precommit_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.832698 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function OVNL3RouterPlugin._subnet_update at 0x77a2befc1f80> subnet after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.833090 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.quota.resource_registry [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Tracking information for resource: router configured {{(pid=104152) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 08 13:10:02.833188 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.quota.resource_registry [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Tracking information for resource: floatingip configured {{(pid=104152) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 08 13:10:02.833188 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.services.ovn_l3.plugin [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Starting OVNL3RouterPlugin
Apr 08 13:10:02.833375 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNPortForwarding.register of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77a2bef36c30>> port_forwarding_plugin after_init 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.833540 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x77a2bef36d80>> router before_create 55550100, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.833692 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x77a2bef36d80>> router precommit_delete 55550100, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.833692 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x77a2bef36d80>> router precommit_create 55550100, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.833903 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x77a2bef36d80>> router precommit_update 55550100, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.836180 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.services.provider_configuration [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Service providers = [] {{(pid=104152) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:170}}
Apr 08 13:10:02.836274 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.db.servicetype_db [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=104152) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Apr 08 13:10:02.837301 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVN_L3_HA_db_mixin._precommit_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> router precommit_create 55549900, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837392 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_add_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> router_interface after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837458 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_floatingip_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> floatingip after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837523 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> floatingip precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837590 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> floatingip precommit_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837681 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_floatingip_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> floatingip after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837782 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_floatingip_status_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> floatingip after_status_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837886 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_floatingip_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> floatingip after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837991 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_portforwarding_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> port_forwarding after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.837991 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_remove_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> router_interface after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.838191 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> router after_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.838191 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_router_create_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> router precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.838191 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_router_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> router after_delete 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.838448 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OvnDriver._process_router_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77a2bf802d20>> router after_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.838448 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.services.service_base [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver' provider for service L3_ROUTER_NAT {{(pid=104152) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Apr 08 13:10:02.838448 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <bound method OVNL3RouterPlugin._post_fork_initialize of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77a2bef36720>> process after_init 55550001, True {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.838631 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding using OVN {{(pid=104152) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 08 13:10:02.838631 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading Plugin: auto_allocate
Apr 08 13:10:02.839387 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x77a2bef10360> network precommit_update 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.839466 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron_lib.callbacks.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x77a2bef10360> network precommit_create 55550000, False {{(pid=104152) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:02.839637 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=104152) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 08 13:10:02.839715 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading Plugin: tag
Apr 08 13:10:02.841738 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=104152) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 08 13:10:02.841814 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading Plugin: timestamp
Apr 08 13:10:02.843463 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=104152) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 08 13:10:02.843463 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading Plugin: network_ip_availability
Apr 08 13:10:02.844079 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=104152) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 08 13:10:02.844154 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading Plugin: flavors
Apr 08 13:10:02.844902 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=104152) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 08 13:10:02.844978 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading Plugin: revisions
Apr 08 13:10:02.845770 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.manager [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=104152) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 08 13:10:02.845882 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG oslo_concurrency.lockutils [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.394s {{(pid=104152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 13:10:02.846040 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] get_extension_paths = OrderedDict({'/opt/stack/neutron/neutron/extensions': 1}) {{(pid=104152) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}}
Apr 08 13:10:02.846107 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Initializing extension manager.
Apr 08 13:10:02.846341 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: __init__.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.846411 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: __pycache__ {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.846480 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: address_group.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.846799 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.846989 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: address-group
Apr 08 13:10:02.847056 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: address_scope.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.847299 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.847447 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: address-scope
Apr 08 13:10:02.847503 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: admin_state_down_before_update.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.847721 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.847855 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension router-admin-state-down-before-update not supported by any of loaded plugins
Apr 08 13:10:02.847917 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: agent.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.848166 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.848297 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: agent
Apr 08 13:10:02.848371 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: agent_resources_synced.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.848545 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.848699 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension agent-resources-synced not supported by any of loaded plugins
Apr 08 13:10:02.848757 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: allowedaddresspairs.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.849288 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.849434 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: allowed-address-pairs
Apr 08 13:10:02.849499 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: auto_allocated_topology.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.849716 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.849854 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: auto-allocated-topology
Apr 08 13:10:02.849912 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: availability_zone.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.850141 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.850275 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: availability_zone
Apr 08 13:10:02.850331 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: availability_zone_filter.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.850527 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.850674 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension availability_zone_filter not supported by any of loaded plugins
Apr 08 13:10:02.850730 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: data_plane_status.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.850950 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.851086 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension data-plane-status not supported by any of loaded plugins
Apr 08 13:10:02.851152 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: default_subnetpools.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.851332 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.851465 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: default-subnetpools
Apr 08 13:10:02.851526 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: dhcpagentscheduler.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.851838 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.851975 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: dhcp_agent_scheduler
Apr 08 13:10:02.852042 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: dns.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.852223 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.852359 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: dns-integration
Apr 08 13:10:02.852417 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: dns_domain_ports.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.852603 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.852753 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: dns-domain-ports
Apr 08 13:10:02.852823 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.853006 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like <project_id>, <project_name>, <user_id> and <user_name> as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.853128 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: dns-integration-domain-keywords
Apr 08 13:10:02.853197 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: dvr.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.853394 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.853527 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension dvr not supported by any of loaded plugins
Apr 08 13:10:02.853592 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: ecmp_routes.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.853789 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.853921 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension ecmp_routes not supported by any of loaded plugins
Apr 08 13:10:02.853981 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: empty_string_filtering.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.854165 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.854298 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: empty-string-filtering
Apr 08 13:10:02.854359 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.854541 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.854689 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Apr 08 13:10:02.854755 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.854952 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.855083 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Apr 08 13:10:02.855143 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: external_net.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.855327 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.855458 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: external-net
Apr 08 13:10:02.855523 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: extra_dhcp_opt.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.855713 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.855844 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: extra_dhcp_opt
Apr 08 13:10:02.855915 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: extraroute.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.856090 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.856221 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: extraroute
Apr 08 13:10:02.856289 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: extraroute_atomic.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.856472 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.856604 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: extraroute-atomic
Apr 08 13:10:02.856696 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: filter_validation.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.856878 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.857008 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: filter-validation
Apr 08 13:10:02.857062 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: fip_pf_description.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.857247 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.857379 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Apr 08 13:10:02.857434 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: fip_pf_detail.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.857639 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Floating IP port forwarding detail" alias="floating-ip-port-forwarding-detail" description="Allow list floating ip return more port forwarding data, include'id' and 'internal_port_id'" updated="2022-05-06T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.857767 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: floating-ip-port-forwarding-detail
Apr 08 13:10:02.857834 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: fip_pf_port_range.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.858013 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add support to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.858142 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins
Apr 08 13:10:02.858195 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: fip_port_details.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.858482 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.858632 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: fip-port-details
Apr 08 13:10:02.858705 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: flavors.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.858928 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.859063 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: flavors
Apr 08 13:10:02.859119 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.859370 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.859505 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Apr 08 13:10:02.859570 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: floatingip_pools.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.859799 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.859932 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: floatingip-pools
Apr 08 13:10:02.860004 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: ip_allocation.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.860179 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.860313 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension ip_allocation not supported by any of loaded plugins
Apr 08 13:10:02.860384 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.860558 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.860708 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension ip-substring-filtering not supported by any of loaded plugins
Apr 08 13:10:02.860778 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l2_adjacency.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.860959 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.861090 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension l2_adjacency not supported by any of loaded plugins
Apr 08 13:10:02.861160 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.861483 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.861626 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: router
Apr 08 13:10:02.861707 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_conntrack_helper.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.862167 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.862307 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Apr 08 13:10:02.862373 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_enable_default_route_bfd.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.862566 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Enable Default Route BFD" alias="enable-default-route-bfd" description="Enables configurable BFD behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.862719 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: enable-default-route-bfd
Apr 08 13:10:02.862785 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_enable_default_route_ecmp.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.862998 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Enable Default Route ECMP" alias="enable-default-route-ecmp" description="Enables configurable ECMP behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.863127 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: enable-default-route-ecmp
Apr 08 13:10:02.863183 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.863377 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.863500 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: ext-gw-mode
Apr 08 13:10:02.863569 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.863760 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.863890 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: l3-ha
Apr 08 13:10:02.863957 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.864132 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.864261 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins
Apr 08 13:10:02.864329 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_extra_gws.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.864503 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron L3 External Gateway Multihoming" alias="external-gateway-multihoming" description="Allow multiple external gateway ports per router" updated="2023-01-18T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.864650 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: external-gateway-multihoming
Apr 08 13:10:02.864716 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_flavors.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.864889 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.865018 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: l3-flavors
Apr 08 13:10:02.865087 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_ndp_proxy.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.865314 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.865444 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension l3-ndp-proxy not supported by any of loaded plugins
Apr 08 13:10:02.865512 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.865704 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.865834 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension l3-port-ip-change-not-allowed not supported by any of loaded plugins
Apr 08 13:10:02.865911 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: l3agentscheduler.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.866302 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.866441 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension l3_agent_scheduler not supported by any of loaded plugins
Apr 08 13:10:02.866511 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: local_ip.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.866780 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.866945 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension local_ip not supported by any of loaded plugins
Apr 08 13:10:02.866994 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: logging.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.867246 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.867378 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension logging not supported by any of loaded plugins
Apr 08 13:10:02.867451 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: metering.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.868410 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.868547 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension metering not supported by any of loaded plugins
Apr 08 13:10:02.868622 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.868830 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.868967 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension metering_source_and_destination_fields not supported by any of loaded plugins
Apr 08 13:10:02.869018 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: multiprovidernet.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.869213 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.869340 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: multi-provider
Apr 08 13:10:02.869409 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: netmtu.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.869593 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.869733 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: net-mtu
Apr 08 13:10:02.869803 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: netmtu_writable.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.869984 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.870116 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: net-mtu-writable
Apr 08 13:10:02.870186 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: network_availability_zone.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.870385 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.870518 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: network_availability_zone
Apr 08 13:10:02.870588 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: network_ha.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.870785 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Network HA creation flag" alias="network_ha" description="Network high availability creation flag." updated="2023-04-27T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.870944 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension network_ha not supported by any of loaded plugins
Apr 08 13:10:02.871007 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: network_ip_availability.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.871198 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.871331 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: network-ip-availability
Apr 08 13:10:02.871398 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: network_ip_availability_details.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.871591 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Network IP Availability Details Extension" alias="network-ip-availability-details" description="Add ip_availability_details attribute to network-ip-availabilities resource." updated="2025-10-31T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.871745 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: network-ip-availability-details
Apr 08 13:10:02.871814 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: network_segment_range.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.872074 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.872193 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension network-segment-range not supported by any of loaded plugins
Apr 08 13:10:02.872263 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: pagination.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.872441 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.872513 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: pagination
Apr 08 13:10:02.872567 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_device_profile.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.872762 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.872898 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: port-device-profile
Apr 08 13:10:02.872976 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_hardware_offload_type.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.873139 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port hardware offload" alias="port-hardware-offload-type" description="Expose port hardware offload extension" updated="2023-05-09T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.873269 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension port-hardware-offload-type not supported by any of loaded plugins
Apr 08 13:10:02.873343 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_hint_ovs_tx_steering.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.873508 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port hint: Open vSwitch Tx steering" alias="port-hint-ovs-tx-steering" description="Enable Port hint: Open vSwitch Tx steering" updated="2023-01-01T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.873656 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension port-hint-ovs-tx-steering not supported by any of loaded plugins
Apr 08 13:10:02.873729 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_hints.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.873897 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port hints" alias="port-hints" description="Backend specific port hints to allow backend specific tuning" updated="2023-01-01T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.874027 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension port-hints not supported by any of loaded plugins
Apr 08 13:10:02.874085 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_mac_address_override.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.874266 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Port MAC address override" alias="port-mac-override" description="Allow overriding the MAC address of a direct-physical Port via the active binding profile" updated="2022-03-18T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.874395 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension port-mac-override not supported by any of loaded plugins
Apr 08 13:10:02.874462 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.874652 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.874786 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: port-mac-address-regenerate
Apr 08 13:10:02.874846 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.875062 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.875194 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: port-numa-affinity-policy
Apr 08 13:10:02.875267 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_numa_affinity_policy_socket.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.875503 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port NUMA affinity policy "socket"" alias="port-numa-affinity-policy-socket" description="Adds "socket" to the supported port NUMA affinity policies" updated="2024-02-09T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.875562 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: port-numa-affinity-policy-socket
Apr 08 13:10:02.875640 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_resource_request.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.875805 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.875935 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension port-resource-request not supported by any of loaded plugins
Apr 08 13:10:02.876004 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_resource_request_groups.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.876186 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.876320 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension port-resource-request-groups not supported by any of loaded plugins
Apr 08 13:10:02.876387 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: port_trusted_vif.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.876564 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port trusted vif" alias="port-trusted-vif" description="Expose port 'trusted' attribute in the API" updated="2024-07-10T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.876709 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension port-trusted-vif not supported by any of loaded plugins
Apr 08 13:10:02.876763 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: portbindings.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.876950 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.877084 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: binding
Apr 08 13:10:02.877153 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: portbindings_extended.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.877352 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.877485 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: binding-extended
Apr 08 13:10:02.877554 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: portsecurity.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.877749 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.877879 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: port-security
Apr 08 13:10:02.877947 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: project_id.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.878130 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.878201 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: project-id
Apr 08 13:10:02.878279 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: providernet.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.878441 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.878577 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: provider
Apr 08 13:10:02.878663 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qinq.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.878854 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="QinQ networks" alias="qinq" description="Expose network 'qinq' attribute in the API. This allows to configure network to allow vlan in vlan configuration using 0x8a88 ethertype (QinQ)." updated="2024-12-02T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.879016 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: qinq
Apr 08 13:10:02.879119 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.879787 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.879920 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos not supported by any of loaded plugins
Apr 08 13:10:02.879992 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.880199 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.880368 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Apr 08 13:10:02.880444 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.880633 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.880782 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Apr 08 13:10:02.880857 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_default.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.881025 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.881177 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-default not supported by any of loaded plugins
Apr 08 13:10:02.881243 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_fip.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.881422 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.881541 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-fip not supported by any of loaded plugins
Apr 08 13:10:02.881644 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_fip_network_policy.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.881800 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.881928 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-fip-network-policy not supported by any of loaded plugins
Apr 08 13:10:02.882004 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_gateway_ip.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.882168 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.882299 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-gateway-ip not supported by any of loaded plugins
Apr 08 13:10:02.882366 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_port_network_policy.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.882551 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.882684 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-port-network-policy not supported by any of loaded plugins
Apr 08 13:10:02.882761 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.882965 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.883099 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-pps-minimum not supported by any of loaded plugins
Apr 08 13:10:02.883163 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.883348 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.883479 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins
Apr 08 13:10:02.883536 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_pps_rule.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.883762 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.883895 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-pps not supported by any of loaded plugins
Apr 08 13:10:02.883952 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_rule_type_details.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.884135 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.884265 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-rule-type-details not supported by any of loaded plugins
Apr 08 13:10:02.884329 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_rule_type_filter.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.884506 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.884663 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-rule-type-filter not supported by any of loaded plugins
Apr 08 13:10:02.884721 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: qos_rules_alias.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.884906 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.885037 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension qos-rules-alias not supported by any of loaded plugins
Apr 08 13:10:02.885113 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: quota_check_limit.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.885266 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.885400 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: quota-check-limit
Apr 08 13:10:02.885489 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: quota_check_limit_default.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.885678 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Quota engine limit check by default" alias="quota-check-limit-default" description="By default, the Neutron quota engine checks the resource usage before applying a new quota limit" updated="2024-08-21T16:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.885814 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: quota-check-limit-default
Apr 08 13:10:02.885907 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: quotasv2.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.886370 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.886498 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: quotas
Apr 08 13:10:02.886498 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: quotasv2_detail.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.886772 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.886885 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: quota_details
Apr 08 13:10:02.886885 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: rbac.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.887292 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.887434 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: rbac-policies
Apr 08 13:10:02.887516 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: rbac_address_group.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.887714 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.887847 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension rbac-address-group not supported by any of loaded plugins
Apr 08 13:10:02.887924 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: rbac_address_scope.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.888071 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.888216 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: rbac-address-scope
Apr 08 13:10:02.888274 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: rbac_security_groups.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.888449 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.888591 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: rbac-security-groups
Apr 08 13:10:02.888672 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: rbac_subnetpool.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.888848 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.888985 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension rbac-subnetpool not supported by any of loaded plugins
Apr 08 13:10:02.889068 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: revisionifmatch.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.889230 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.889362 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: revision-if-match
Apr 08 13:10:02.889435 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: revisions.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.889625 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.889769 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: standard-attr-revisions
Apr 08 13:10:02.889837 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: router_availability_zone.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.890037 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.890170 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: router_availability_zone
Apr 08 13:10:02.890240 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: router_enable_snat.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.890415 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Exposes the router "enable_snat" read-only configuration flag" alias="router-enable-snat" description="Exposes the router "enable_snat" read-only configuration flag" updated="2025-09-18T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.890549 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: router-enable-snat
Apr 08 13:10:02.890639 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: routerservicetype.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.890809 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.890945 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension router-service-type not supported by any of loaded plugins
Apr 08 13:10:02.891052 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: security_groups_default_rules.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.891379 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Default rules for security groups" alias="security-groups-default-rules" description="Configure set of security group rules used as default rules for every new security group" updated="2022-12-19T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.891512 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: security-groups-default-rules
Apr 08 13:10:02.891578 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.891788 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.891930 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: security-groups-normalized-cidr
Apr 08 13:10:02.891984 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: security_groups_port_filtering.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.892161 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.892297 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension port-security-groups-filtering not supported by any of loaded plugins
Apr 08 13:10:02.892365 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.892540 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.892703 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: security-groups-remote-address-group
Apr 08 13:10:02.892767 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: security_groups_rules_belongs_to_default_sg.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.892931 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Security group rule belongs to the project's default security group" alias="security-groups-rules-belongs-to-default-sg" description="Flag to determine if the security group rule belongs to the project's default security group" updated="2023-05-23T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.893062 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: security-groups-rules-belongs-to-default-sg
Apr 08 13:10:02.893137 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.893305 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.893439 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: security-groups-shared-filtering
Apr 08 13:10:02.893514 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: securitygroup.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.894827 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.894965 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: security-group
Apr 08 13:10:02.895053 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: segment.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.895299 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.895435 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension segment not supported by any of loaded plugins
Apr 08 13:10:02.895502 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.895707 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.895837 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Apr 08 13:10:02.895911 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: servicetype.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.896109 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.896240 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: service-type
Apr 08 13:10:02.896310 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: sorting.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.896488 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.896562 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: sorting
Apr 08 13:10:02.896943 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: standard_attr_segment.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.896943 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.896943 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension standard-attr-segment not supported by any of loaded plugins
Apr 08 13:10:02.897033 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: standardattrdescription.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.897450 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.897450 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: standard-attr-description
Apr 08 13:10:02.897450 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: stateful_security_group.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.897563 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.897721 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: stateful-security-group
Apr 08 13:10:02.897794 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: stdattrs_common.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.897945 np0000164309 neutron-ovn-maintenance-worker[104152]: WARNING neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Apr 08 13:10:02.898013 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.898184 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.898318 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: subnet-dns-publish-fixed-ip
Apr 08 13:10:02.898387 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: subnet_external_network.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.898560 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Subnet belongs to an external network" alias="subnet-external-network" description="Informs if the subnet belongs to an external network" updated="2024-02-05T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.898713 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: subnet-external-network
Apr 08 13:10:02.898785 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: subnet_onboard.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.899117 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.899258 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension subnet_onboard not supported by any of loaded plugins
Apr 08 13:10:02.899331 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.899514 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.899667 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Apr 08 13:10:02.899740 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: subnet_service_types.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.899928 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.900057 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: subnet-service-types
Apr 08 13:10:02.900127 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: subnetallocation.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.900318 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.900453 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: subnet_allocation
Apr 08 13:10:02.900525 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.900737 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.900873 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: subnetpool-prefix-ops
Apr 08 13:10:02.900947 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: tag_creation.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.901118 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Tag creation extension" alias="tag-creation" description="Allow to create multiple tags for a resource" updated="2024-23-07T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.901261 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: tag-creation
Apr 08 13:10:02.901321 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.901498 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.901647 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Apr 08 13:10:02.901720 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: tagging.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.902306 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.902448 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: standard-attr-tag
Apr 08 13:10:02.902518 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: timestamp.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.902762 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.902895 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: standard-attr-timestamp
Apr 08 13:10:02.902975 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: trunk.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.903190 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.903317 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension trunk not supported by any of loaded plugins
Apr 08 13:10:02.903386 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: trunk_details.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.903559 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.903706 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension trunk-details not supported by any of loaded plugins
Apr 08 13:10:02.903775 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: uplink_status_propagation.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.903951 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.904090 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension uplink-status-propagation not supported by any of loaded plugins
Apr 08 13:10:02.904147 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: uplink_status_propagation_updatable.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.904319 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Uplink status propagation updatable extension" alias="uplink-status-propagation-updatable" description="Provides ability to update the port uplink status." updated="2024-09-03T18:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.904450 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Extension uplink-status-propagation-updatable not supported by any of loaded plugins
Apr 08 13:10:02.904521 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loading extension file: vlantransparent.py {{(pid=104152) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 08 13:10:02.904729 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=104152) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 08 13:10:02.904864 np0000164309 neutron-ovn-maintenance-worker[104152]: INFO neutron.api.extensions [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Loaded extension: vlan-transparent
Apr 08 13:10:02.907148 np0000164309 neutron-ovn-maintenance-worker[104152]: WARNING oslo_service.backend._threading.service [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Service MaintenanceWorker is not picklable with spawn; falling back to fork. Please make the service spawn-safe to avoid this fallback.
Apr 08 13:10:02.907428 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Full set of CONF: {{(pid=104152) _load_service_manager_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:59}}
Apr 08 13:10:02.907484 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ******************************************************************************** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 08 13:10:02.907559 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Configuration options gathered from: {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 08 13:10:02.907604 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 08 13:10:02.907736 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 08 13:10:02.907791 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ================================================================================ {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 08 13:10:02.907913 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] agent_down_time                = 75 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.907996 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] allow_automatic_dhcp_failover  = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908082 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] allow_bulk                     = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908247 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908333 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] api_extensions_path            =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908423 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] api_paste_config               = api-paste.ini {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908514 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] api_workers                    = 4 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908603 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] auth_strategy                  = keystone {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908707 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] backlog                        = 4096 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908796 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] base_mac                       = fa:16:3e:00:00:00 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908898 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] bind_host                      = 0.0.0.0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.908987 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] bind_port                      = 9696 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909071 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] client_socket_timeout          = 900 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909161 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] config_dir                     = [] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909228 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909315 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] config_source                  = [] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909405 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] control_exchange               = neutron {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909492 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] core_plugin                    = ml2 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909579 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] debug                          = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909683 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] default_availability_zones     = [] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909835 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.909920 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] dhcp_agent_notification        = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910000 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] dhcp_agents_per_network        = 1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910081 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] dhcp_lease_duration            = 86400 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910171 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] dhcp_load_type                 = networks {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910257 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] dns_domain                     = openstacklocal {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910345 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910429 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] enable_default_route_bfd       = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910511 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] enable_default_route_ecmp      = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910594 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] enable_dvr                     = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910695 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] enable_new_agents              = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910780 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910860 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] enable_snat_by_default         = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.910939 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] enable_traditional_dhcp        = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911027 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] external_dns_driver            = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911139 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] filter_validation              = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911215 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] global_physnet_mtu             = 1430 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911278 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] graceful_shutdown_timeout      = 60 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911403 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] host                           = np0000164309 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911484 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] host_dvr_for_dhcp              = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911569 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] http_retries                   = 3 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911674 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] instance_format                = [instance: %(uuid)s]  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911760 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911848 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ipam_driver                    = internal {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.911934 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ipv6_pd_enabled                = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912015 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] l3_ha                          = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912101 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912189 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] l3_ha_network_physical_name    =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912275 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] l3_ha_network_type             =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912365 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_color                      = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912452 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_config_append              = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912541 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912634 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_dir                        = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912730 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_file                       = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912793 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_options                    = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912877 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_rotate_interval            = 1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.912967 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_rotate_interval_type       = days {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913053 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] log_rotation_type              = none {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913116 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913180 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913271 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913353 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913406 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913500 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] max_allowed_address_pair       = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913581 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] max_dns_nameservers            = 5 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913683 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] max_header_line                = 16384 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913769 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] max_l3_agents_per_router       = 3 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913852 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] max_logfile_count              = 30 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.913940 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] max_logfile_size_mb            = 200 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914019 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] max_routes                     = 30 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914101 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] max_subnet_host_routes         = 20 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914189 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] my_ip                          = 199.204.45.19 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914274 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] my_ipv6                        = 2604:e100:1:0:f816:3eff:fe42:869b {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914357 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] network_auto_schedule          = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914438 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] network_link_prefix            = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914525 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914627 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] notify_nova_on_port_data_changes = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914717 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] notify_nova_on_port_status_changes = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914803 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] pagination_max_limit           = -1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914888 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] periodic_fuzzy_delay           = 5 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.914973 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] periodic_interval              = 40 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915053 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] publish_errors                 = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915180 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] rate_limit_burst               = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915268 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] rate_limit_except_level        = CRITICAL {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915351 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] rate_limit_interval            = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915436 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] retry_until_window             = 30 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915520 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] router_distributed             = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915604 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] rpc_resources_processing_step  = 20 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915704 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] rpc_response_max_timeout       = 600 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915788 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] rpc_response_timeout           = 60 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915880 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] rpc_state_report_workers       = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.915957 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] rpc_workers                    = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916039 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] send_events_interval           = 2 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916128 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] service_plugins                = ['ovn-router'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916215 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] setproctitle                   = on {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916296 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] shell_completion               = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916382 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] state_path                     = /opt/stack/data/neutron {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916469 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] syslog_log_facility            = LOG_USER {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916551 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] tcp_keepidle                   = 600 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916659 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] transport_url                  = **** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916745 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] use_journal                    = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916828 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] use_json                       = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916911 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] use_ssl                        = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.916978 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] use_stderr                     = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.917076 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] use_syslog                     = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.917155 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] vlan_qinq                      = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.917237 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] vlan_transparent               = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.917377 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] wsgi_default_pool_size         = 100 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.917466 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] wsgi_keep_alive                = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.917554 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.917653 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] wsgi_server_debug              = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.917752 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_concurrency.disable_process_locking = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.917845 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.917948 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.connection_string     = messaging:// {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918038 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.enabled               = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918125 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.es_doc_type           = notification {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918212 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.es_scroll_size        = 10000 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918301 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.es_scroll_time        = 2m {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918387 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.filter_error_trace    = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918477 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.hmac_keys             = **** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918568 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.sentinel_service_name = mymaster {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918682 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.socket_timeout        = 0.1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918765 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.trace_requests        = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918854 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler.trace_sqlalchemy      = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.918953 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler_jaeger.process_tags   = {} {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919021 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler_jaeger.service_name_prefix = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919145 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] profiler_otlp.service_name_prefix = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919218 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919308 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919383 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919471 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919558 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919672 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.enforce_new_defaults = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.919842 np0000164309 neutron-ovn-maintenance-worker[104152]: WARNING oslo_config.cfg [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 08 13:10:02.919937 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.enforce_scope      = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920026 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.policy_default_rule = default {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920123 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920212 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920303 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920387 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920471 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920554 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920657 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920747 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920845 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.920938 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] service_providers.service_provider = [] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921033 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.auth_section              = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921124 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.auth_type                 = password {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921305 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.auth_url                  = https://199.204.45.19/identity {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921391 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.cafile                    = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921476 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.certfile                  = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921564 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.collect_timing            = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921669 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.default_domain_id         = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921753 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.default_domain_name       = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921839 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.domain_id                 = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.921924 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.domain_name               = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922018 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.endpoint_type             = public {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922103 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.insecure                  = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922186 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.keyfile                   = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922273 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.password                  = **** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922357 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.project_domain_id         = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922445 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.project_domain_name       = Default {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922532 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.project_id                = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922630 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.project_name              = service {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922732 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.region_name               = RegionOne {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922819 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.split_loggers             = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922903 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.system_scope              = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.922988 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.timeout                   = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923070 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.trust_id                  = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923194 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.user_domain_id            = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923284 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.user_domain_name          = Default {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923367 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.user_id                   = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923459 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] nova.username                  = nova {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923549 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.auth_section         = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923658 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.auth_type            = password {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923743 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.cafile               = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923825 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.certfile             = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.923911 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.collect_timing       = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924005 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.endpoint_type        = public {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924091 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.insecure             = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924173 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.keyfile              = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924255 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.region_name          = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924340 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.split_loggers        = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924423 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] placement.timeout              = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924511 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.auth_section            = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924596 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.auth_type               = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924695 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.cafile                  = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924778 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.certfile                = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924863 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.collect_timing          = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.924946 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.connect_retries         = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925030 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.connect_retry_delay     = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925115 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.enable_notifications    = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925199 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.endpoint_override       = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925283 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.insecure                = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925365 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.interface               = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925447 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.keyfile                 = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925533 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.max_version             = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925624 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.min_version             = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925713 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.region_name             = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925799 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.retriable_status_codes  = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925882 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.service_name            = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.925963 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.service_type            = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926045 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.split_loggers           = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926127 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.status_code_retries     = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926210 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.status_code_retry_delay = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926291 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.timeout                 = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926373 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.valid_interfaces        = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926457 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ironic.version                 = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926547 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] cli_script.dry_run             = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926661 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926748 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926834 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.926919 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927005 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927090 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927202 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927285 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927370 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927460 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.hostname = np0000164309 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927545 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927650 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927740 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927828 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.927913 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928002 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928088 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928174 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928266 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928352 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928438 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928538 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928646 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928706 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928801 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928874 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.928958 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929043 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929127 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929211 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929296 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.ssl      = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929385 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929480 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929553 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929662 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929748 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929832 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.929924 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_notifications.driver = [] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930014 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_notifications.retry = -1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930107 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930243 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_messaging_notifications.transport_url = **** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930272 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_reports.file_event_handler = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930356 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930439 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_reports.log_dir           = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930527 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930618 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.default_quota           = -1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930726 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930811 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_floatingip        = 50 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930898 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_network           = 100 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.930996 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_port              = 500 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931168 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_rbac_policy       = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931168 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_router            = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931267 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_security_group    = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931352 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931435 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.quota_subnet            = 100 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931521 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] QUOTAS.track_quota_usage       = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931629 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931718 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep.group                  = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931801 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep.helper_command         = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931887 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep.log_daemon_traceback   = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.931976 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep.logger_name            = oslo_privsep.daemon {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932063 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep.thread_pool_size       = 16 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932146 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep.user                   = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932237 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932319 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_dhcp_release.group     = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932401 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_dhcp_release.helper_command = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932486 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932573 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932675 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_dhcp_release.thread_pool_size = 16 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932759 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_dhcp_release.user      = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932849 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.932931 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_ovs_vsctl.group        = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933017 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_ovs_vsctl.helper_command = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933100 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933185 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933268 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933350 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_ovs_vsctl.user         = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933440 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_namespace.capabilities = [21] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933522 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_namespace.group        = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933602 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_namespace.helper_command = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933705 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_namespace.log_daemon_traceback = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933791 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933875 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_namespace.thread_pool_size = 16 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.933956 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_namespace.user         = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934044 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_conntrack.capabilities = [12] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934126 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_conntrack.group        = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934207 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_conntrack.helper_command = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934290 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934378 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934462 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_conntrack.thread_pool_size = 16 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934543 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_conntrack.user         = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934712 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_link.capabilities      = [12, 21] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934759 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_link.group             = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934800 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_link.helper_command    = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934892 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_link.log_daemon_traceback = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.934976 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935059 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_link.thread_pool_size  = 16 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935141 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] privsep_link.user              = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935257 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935347 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935432 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] AGENT.use_helper_for_ns_read   = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935520 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] SECURITYGROUP.enable_ipset     = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935609 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] SECURITYGROUP.enable_security_group = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935709 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] SECURITYGROUP.firewall_driver  = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935797 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935885 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] experimental.ipv6_pd_enabled   = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.935985 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936067 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.external_network_type      = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936158 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.mechanism_drivers          = ['ovn'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936249 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.overlay_ip_version         = 4 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936336 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.path_mtu                   = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936422 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.physical_network_mtus      = {} {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936518 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.project_network_types      = ['geneve'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936623 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936720 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936816 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2_type_flat.flat_networks    = ['public'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.936910 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2_type_geneve.max_header_size = 38 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937005 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937097 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937188 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] network_log.burst_limit        = 25 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937272 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] network_log.local_output_log_base = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937357 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] network_log.rate_limit         = 100 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937448 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.asyncio_connection    = **** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937530 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.asyncio_slave_connection = **** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937635 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.backend               = sqlalchemy {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937725 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.connection            = **** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937811 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.connection_debug      = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937899 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.connection_parameters =  {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.937984 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.connection_recycle_time = 3600 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938070 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.connection_trace      = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938155 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.db_inc_retry_interval = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938240 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.db_max_retries        = 20 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938325 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.db_max_retry_interval = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938409 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.db_retry_interval     = 1 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938494 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.max_overflow          = 50 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938579 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.max_pool_size         = 5 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938680 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.max_retries           = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938770 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938853 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.mysql_wsrep_sync_wait = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.938936 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.pool_timeout          = None {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939020 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.retry_interval        = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939103 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.slave_connection      = **** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939214 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.sqlite_synchronous    = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939307 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.synchronous_reader    = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939390 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] database.use_db_reconnect      = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939485 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.bfd_min_rx                 = 1000 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939570 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.bfd_min_tx                 = 100 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939671 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.bfd_mult                   = 3 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939757 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.broadcast_arps_to_all_routers = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939842 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.dhcp_default_lease_time    = 43200 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.939928 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940018 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.dns_records_ovn_owned      = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940463 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.dns_servers                = [] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940463 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.enable_distributed_floating_ip = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940463 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.fdb_age_threshold          = 300 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940463 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ha_failover_strategy       = normal {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940463 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.live_migration_activation_strategy = rarp {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940654 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.localnet_learn_fdb         = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940654 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.mac_binding_age_threshold  = 300 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940734 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.neutron_sync_mode          = log {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940779 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_dhcp4_global_options   = {} {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940864 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_dhcp6_global_options   = {} {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.940950 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_l3_scheduler           = leastloaded {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941039 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_metadata_enabled       = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941127 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941216 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941310 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_nb_connection          = ['ssl:199.204.45.19:6641'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941398 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941483 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_router_indirect_snat   = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941569 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941675 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941766 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_sb_connection          = ['ssl:199.204.45.19:6642'] {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941854 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.941939 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovs_create_tap             = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942022 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovsdb_connection_timeout   = 180 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942111 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovsdb_log_level            = INFO {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942197 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovsdb_probe_interval       = 60000 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942281 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.ovsdb_retry_max_interval   = 180 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942364 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.stateless_nat_enabled      = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942452 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942542 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] OVS.bridge_mac_table_size      = 50000 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942642 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] OVS.igmp_flood                 = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942730 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] OVS.igmp_flood_reports         = True {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.942814 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] OVS.igmp_flood_unregistered    = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.943433 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] OVS.igmp_snooping_enable       = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.943433 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] OVS.ovsdb_timeout              = 10 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.943433 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn_nb_global.fdb_removal_limit = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.943433 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn_nb_global.ignore_lsp_down  = False {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.943433 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.943433 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG cotyledon.oslo_config_glue [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] ******************************************************************************** {{(pid=104152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 08 13:10:02.943893 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG oslo_service.backend._threading.service [None req-7b9ce9e7-6f46-4252-a313-1ed6d6f03b42 None None] Selected the multiprocessing context: <multiprocessing.context.ForkContext object at 0x77a2c4db6b40> and updated it in Cotyledon ServiceManager: <multiprocessing.context.ForkContext object at 0x77a2c4db6b40> {{(pid=104152) launch_service /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/service.py:394}}
Apr 08 13:10:02.974385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] Full set of CONF: {{(pid=104932) _load_service_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:65}}
Apr 08 13:10:02.974944 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 08 13:10:02.974944 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] Configuration options gathered from: {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 08 13:10:02.974944 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 08 13:10:02.975102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 08 13:10:02.975102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ================================================================================ {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 08 13:10:02.975385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] agent_down_time                = 75 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.975716 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] allow_automatic_dhcp_failover  = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.975907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] allow_bulk                     = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976133 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976207 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] api_extensions_path            =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976296 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] api_paste_config               = api-paste.ini {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] api_workers                    = 4 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] auth_strategy                  = keystone {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] backlog                        = 4096 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] bind_host                      = 0.0.0.0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.976940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] bind_port                      = 9696 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] client_socket_timeout          = 900 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] config_dir                     = [] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977171 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977244 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] config_source                  = [] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977327 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] control_exchange               = neutron {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] core_plugin                    = ml2 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] debug                          = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] default_availability_zones     = [] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977734 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agent_notification        = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agents_per_network        = 1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.977977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] dhcp_lease_duration            = 86400 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978036 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] dhcp_load_type                 = networks {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978141 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] dns_domain                     = openstacklocal {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978203 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_bfd       = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_ecmp      = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978574 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] enable_dvr                     = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978574 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] enable_new_agents              = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978574 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] enable_services_on_agents_with_admin_state_down = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] enable_snat_by_default         = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] enable_traditional_dhcp        = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] external_dns_driver            = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978896 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] fatal_deprecations             = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.978896 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] filter_validation              = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] global_physnet_mtu             = 1430 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] graceful_shutdown_timeout      = 60 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] host                           = np0000164309 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] host_dvr_for_dhcp              = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] http_retries                   = 3 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] instance_format                = [instance: %(uuid)s]  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ipam_driver                    = internal {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ipv6_pd_enabled                = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] l3_ha                          = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979967 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_physical_name    =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.979967 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_type             =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_color                      = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980106 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_config_append              = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980140 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_dir                        = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980240 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_file                       = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_options                    = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval            = 1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval_type       = days {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] log_rotation_type              = none {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980532 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980720 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] max_allowed_address_pair       = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] max_dns_nameservers            = 5 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.980942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] max_header_line                = 16384 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] max_l3_agents_per_router       = 3 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_count              = 30 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_size_mb            = 200 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981205 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] max_routes                     = 30 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] max_subnet_host_routes         = 20 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] my_ip                          = 199.204.45.19 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] my_ipv6                        = 2604:e100:1:0:f816:3eff:fe42:869b {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] network_auto_schedule          = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] network_link_prefix            = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981709 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_data_changes = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_status_changes = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] pagination_max_limit           = -1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] periodic_fuzzy_delay           = 5 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.981980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] periodic_interval              = 40 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982043 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] publish_errors                 = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_burst               = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_except_level        = CRITICAL {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982217 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_interval            = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] retry_until_window             = 30 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] router_distributed             = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982414 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] rpc_resources_processing_step  = 20 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_max_timeout       = 600 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_timeout           = 60 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] rpc_state_report_workers       = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] rpc_workers                    = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] send_events_interval           = 2 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] service_plugins                = ['ovn-router'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982925 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] setproctitle                   = on {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.982994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] shell_completion               = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] state_path                     = /opt/stack/data/neutron {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] syslog_log_facility            = LOG_USER {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] tcp_keepidle                   = 600 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] transport_url                  = **** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] use_journal                    = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] use_json                       = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983530 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] use_ssl                        = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983530 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] use_stderr                     = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983605 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] use_syslog                     = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] vlan_qinq                      = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] vlan_transparent               = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983763 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] wsgi_default_pool_size         = 100 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] wsgi_keep_alive                = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.983964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] wsgi_server_debug              = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 08 13:10:02.984081 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.disable_process_locking = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984277 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.connection_string     = messaging:// {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.enabled               = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_doc_type           = notification {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_size        = 10000 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984571 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_time        = 2m {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984669 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.filter_error_trace    = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.hmac_keys             = **** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.sentinel_service_name = mymaster {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.socket_timeout        = 0.1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.984976 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_requests        = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_sqlalchemy      = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.process_tags   = {} {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.service_name_prefix = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] profiler_otlp.service_name_prefix = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985370 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985438 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985503 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_process_name =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_new_defaults = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985834 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_scope      = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985877 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_default_rule = default {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985920 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.985996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986127 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_timeout     = 60.0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] service_providers.service_provider = [] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_section              = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_type                 = password {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_url                  = https://199.204.45.19/identity {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986524 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.cafile                    = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986563 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.certfile                  = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.collect_timing            = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986662 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_id         = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986708 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_name       = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986744 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_id                 = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_name               = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986821 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.endpoint_type             = public {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.insecure                  = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986898 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.keyfile                   = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.password                  = **** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_id         = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987037 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_name       = Default {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987081 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.project_id                = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.project_name              = service {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.region_name               = RegionOne {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987190 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.split_loggers             = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.system_scope              = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.timeout                   = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987308 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.trust_id                  = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_id            = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987383 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_name          = Default {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987469 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.user_id                   = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987506 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] nova.username                  = nova {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_section         = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987582 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_type            = password {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.cafile               = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987677 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.certfile             = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987714 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.collect_timing       = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.endpoint_type        = public {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987785 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.insecure             = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987831 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.keyfile              = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.region_name          = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987901 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.split_loggers        = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] placement.timeout              = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.987974 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_section            = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_type               = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.cafile                  = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988086 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.certfile                = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.collect_timing          = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retries         = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retry_delay     = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.enable_notifications    = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.endpoint_override       = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.insecure                = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.interface               = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.keyfile                 = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988450 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.max_version             = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988498 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.min_version             = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.region_name             = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.retriable_status_codes  = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_name            = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988690 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_type            = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.split_loggers           = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retries     = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988820 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retry_delay = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.timeout                 = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.valid_interfaces        = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ironic.version                 = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.988988 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] cli_script.dry_run             = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989158 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989202 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989283 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.hostname = np0000164309 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989584 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989684 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989734 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989901 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.989981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990062 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990103 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990137 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990260 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl      = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990421 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990463 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_version =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990661 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.driver = [] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990708 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.retry = -1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990750 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990802 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.transport_url = **** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990900 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.log_dir           = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.990996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.default_quota           = -1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_floatingip        = 50 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991208 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_network           = 100 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_port              = 500 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991350 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_router            = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991397 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group    = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group_rule = 100 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_subnet            = 100 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991555 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.track_quota_usage       = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991611 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991686 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep.group                  = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991765 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep.helper_command         = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991819 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep.log_daemon_traceback   = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991856 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep.logger_name            = oslo_privsep.daemon {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991912 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep.thread_pool_size       = 16 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.991972 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep.user                   = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.group     = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.helper_command = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992128 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.log_daemon_traceback = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992216 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.thread_pool_size = 16 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.user      = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992345 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.group        = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992387 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.helper_command = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992467 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992506 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.user         = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.capabilities = [21] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.group        = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992691 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.helper_command = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.log_daemon_traceback = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992760 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.thread_pool_size = 16 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992829 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.user         = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992898 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.capabilities = [12] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.group        = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.992982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.helper_command = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.log_daemon_traceback = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993051 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993091 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.thread_pool_size = 16 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993127 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.user         = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.capabilities      = [12, 21] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993195 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.group             = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.helper_command    = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993262 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.log_daemon_traceback = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993353 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.thread_pool_size  = 16 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.user              = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] AGENT.use_helper_for_ns_read   = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_ipset     = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_security_group = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.firewall_driver  = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993759 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] experimental.ipv6_pd_enabled   = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.external_network_type      = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.mechanism_drivers          = ['ovn'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.993995 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.overlay_ip_version         = 4 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994047 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.path_mtu                   = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.physical_network_mtus      = {} {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.project_network_types      = ['geneve'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994272 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_flat.flat_networks    = ['public'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.max_header_size = 38 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994365 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994481 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] network_log.burst_limit        = 25 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994525 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] network_log.local_output_log_base = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] network_log.rate_limit         = 100 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_connection    = **** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994688 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_slave_connection = **** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.backend               = sqlalchemy {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.connection            = **** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.connection_debug      = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994880 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.connection_parameters =  {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.connection_recycle_time = 3600 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.994977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.connection_trace      = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.db_inc_retry_interval = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retries        = 20 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retry_interval = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995140 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.db_retry_interval     = 1 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.max_overflow          = 50 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.max_pool_size         = 5 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.max_retries           = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_wsrep_sync_wait = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.pool_timeout          = None {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.retry_interval        = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995506 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.slave_connection      = **** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.sqlite_synchronous    = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.synchronous_reader    = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] database.use_db_reconnect      = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_rx                 = 1000 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_tx                 = 100 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_mult                   = 3 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995869 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.broadcast_arps_to_all_routers = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.dhcp_default_lease_time    = 43200 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995937 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.995970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_records_ovn_owned      = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_servers                = [] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996044 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.enable_distributed_floating_ip = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.fdb_age_threshold          = 300 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ha_failover_strategy       = normal {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.live_migration_activation_strategy = rarp {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996195 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.localnet_learn_fdb         = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996235 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.mac_binding_age_threshold  = 300 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.neutron_sync_mode          = log {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996331 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp4_global_options   = {} {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp6_global_options   = {} {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_l3_scheduler           = leastloaded {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_metadata_enabled       = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996547 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_connection          = ['ssl:199.204.45.19:6641'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_router_indirect_snat   = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_connection          = ['ssl:199.204.45.19:6642'] {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovs_create_tap             = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_connection_timeout   = 180 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.996975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_log_level            = INFO {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997044 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_probe_interval       = 60000 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997044 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_retry_max_interval   = 180 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.stateless_nat_enabled      = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] OVS.bridge_mac_table_size      = 50000 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood                 = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997246 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_reports         = True {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_unregistered    = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_snooping_enable       = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997383 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] OVS.ovsdb_timeout              = 10 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997418 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.ignore_lsp_down  = False {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997512 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 08 13:10:02.997550 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=104932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 08 13:10:02.997745 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG cotyledon._service_worker [-] Run service ServiceWrapper(0) [104932] {{(pid=104932) wait_forever /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/_service_worker.py:218}}
Apr 08 13:10:02.998780 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-517301', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._post_fork_initialize-63298'] for process (None), after_init {{(pid=104932) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 08 13:10:03.000362 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry
Apr 08 13:10:03.085684 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Switch.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 08 13:10:03.085830 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Router.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 08 13:10:03.085830 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Load_Balancer.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 08 13:10:03.086049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Copp.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Meter.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Load_Balancer_Group.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index HA_Chassis_Group.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Address_Set.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Connection.target {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Gateway_Chassis.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Mirror.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Template_Var.chassis {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Router_Port.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port_Group.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.086404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Switch_Port.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.088702 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.19:6641: connecting...
Apr 08 13:10:03.094652 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.19:6641: connected
Apr 08 13:10:03.123182 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbSbOvnIdl for MaintenanceWorker with retry
Apr 08 13:10:03.154894 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 08 13:10:03.155018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 08 13:10:03.155018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.155207 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=104932) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 08 13:10:03.157037 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.19:6642: connecting...
Apr 08 13:10:03.166501 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.19:6642: connected
Apr 08 13:10:03.202268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77a2bef86690>> floatingip precommit_update 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.202389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77a2bef86690>> floatingip precommit_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.202446 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77a2bef86690>> floatingip before_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.202506 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77a2bef86690>> floatingip before_update 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.202567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77a2bef86690>> port after_update 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.202682 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77a2bef86690>> port precommit_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.202934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding.register-63099'] for port_forwarding_plugin (None), after_init {{(pid=104932) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 08 13:10:03.203001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77a2bef36c30>> port_forwarding after_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.203070 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77a2bef36c30>> router_interface after_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.203150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77a2bef36c30>> port_forwarding after_update 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.203210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77a2bef36c30>> port_forwarding after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.203275 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77a2bef36c30>> router_interface after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.203410 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 08 13:10:03.203475 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [-] Starting OVNClientPlacementExtension
Apr 08 13:10:03.203876 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x77a2bfb74ce0>> segment before_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.203952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x77a2bfb74ce0>> subnet precommit_delete_associations 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> segment_host_mapping after_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204537 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_removal_from_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> segment_host_mapping after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> port after_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204699 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> port after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> port after_update 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> segment after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204888 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> subnet after_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204888 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> subnet after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.204999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77a2bfd06060>> subnet after_update 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.262348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x77a2bfba20f0>> subnet after_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.262457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x77a2bfba20f0>> subnet after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.262457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x77a2bfba20f0>> subnet before_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.262595 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x77a2bfba20f0>> subnet before_update 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.264752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_resource_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x77a2bfce7080>> security_group after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.264752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_target_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x77a2bfce7080>> port after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.264916 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.logapi.drivers.ovn.driver.DriverBase._register-132957972'] for logging-plugin (None), after_init {{(pid=104932) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 08 13:10:03.265011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x77a2bfba3470>> security_group_rule after_create 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.265097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x77a2bfba3470>> security_group_rule after_update 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:03.265170 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x77a2bfba3470>> security_group_rule after_delete 55550000, False {{(pid=104932) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 08 13:10:12.709056 np0000164309 neutron-ovn-maintenance-worker[104152]: DEBUG dbcounter [-] [104152] Writing DB stats neutron:SELECT=4 {{(pid=104152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:10:13.266244 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Northbound DB sync process started @ 2026-04-08 13:10:13.265824 {{(pid=104932) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:99}}
Apr 08 13:10:13.268906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync port groups started @ 2026-04-08 13:10:13.268385 {{(pid=104932) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:132}}
Apr 08 13:10:13.286152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writer thread running {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 08 13:10:13.296983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync port groups completed @ 2026-04-08 13:10:13.296716 {{(pid=104932) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:196}}
Apr 08 13:10:13.297158 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync networks, ports and DHCP options started @ 2026-04-08 13:10:13.296945 {{(pid=104932) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1150}}
Apr 08 13:10:13.396022 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.services.segments.db [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x77a2bfd97ce0>,) {'filters': {'network_id': ['74c4c8eb-ebdb-4dc6-b746-23c495d5d99c'], 'is_dynamic': False}} {{(pid=104932) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Apr 08 13:10:13.400592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync metadata ports started {{(pid=104932) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1095}}
Apr 08 13:10:13.626868 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync metadata ports completed {{(pid=104932) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1147}}
Apr 08 13:10:13.627080 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync DHCP options for Neutron subnets started {{(pid=104932) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:947}}
Apr 08 13:10:13.682015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync DHCP options for Neutron subnets completed @ 2026-04-08 13:10:13.681630 {{(pid=104932) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1020}}
Apr 08 13:10:13.682749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 08 13:10:13.683064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned started {{(pid=104932) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1025}}
Apr 08 13:10:13.683163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned completed {{(pid=104932) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1084}}
Apr 08 13:10:13.683322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync networks, ports and DHCP options completed @ 2026-04-08 13:10:13.683164 {{(pid=104932) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1319}}
Apr 08 13:10:13.683442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync ACLs started @ 2026-04-08 13:10:13.683315 {{(pid=104932) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:239}}
Apr 08 13:10:13.720238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync ACLs completed @ 2026-04-08 13:10:13.720008 {{(pid=104932) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:429}}
Apr 08 13:10:13.720373 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync routers and router ports started @ 2026-04-08 13:10:13.720240 {{(pid=104932) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:734}}
Apr 08 13:10:13.770578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 08 13:10:13.770973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync routers and router ports completed @ 2026-04-08 13:10:13.770689 {{(pid=104932) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:942}}
Apr 08 13:10:13.771115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync port QoS policies started @ 2026-04-08 13:10:13.770967 {{(pid=104932) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1367}}
Apr 08 13:10:13.771216 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] Starting OVNClientQosExtension
Apr 08 13:10:13.787796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync port QoS policies completed @ 2026-04-08 13:10:13.787640 {{(pid=104932) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1390}}
Apr 08 13:10:13.787882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync Floating IP QoS policies started @ 2026-04-08 13:10:13.787770 {{(pid=104932) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1395}}
Apr 08 13:10:13.787955 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] Starting OVNClientQosExtension
Apr 08 13:10:13.806574 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync Floating IP QoS policies completed @ 2026-04-08 13:10:13.806411 {{(pid=104932) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1418}}
Apr 08 13:10:13.806702 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync Floating IP NAT rules started @ 2026-04-08 13:10:13.806536 {{(pid=104932) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1423}}
Apr 08 13:10:13.806870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-NB Sync Floating IP NAT rules completed @ 2026-04-08 13:10:13.806738 {{(pid=104932) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1446}}
Apr 08 13:10:13.806940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0f16beed-6cdf-4ad5-b1d6-dad77ab2a47c None None] OVN-Northbound DB sync process completed @ 2026-04-08 13:10:13.806833 {{(pid=104932) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:112}}
Apr 08 13:10:23.268602 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Southbound DB sync process started @ 2026-04-08 13:10:23.268028 {{(pid=104932) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1474}}
Apr 08 13:10:23.270243 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 08 13:10:23.271105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] OVN-SB Sync hostname and physical networks started @ 2026-04-08 13:10:23.270688 {{(pid=104932) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1501}}
Apr 08 13:10:23.276014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.277743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_dhcp_options_consistency {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.277897 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fair_meter_consistency {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.277897 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fdb_aging_settings {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_igmp_snoop_support {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_inconsistencies {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_global_dhcp_opts {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_provider_distributed_ports {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278677 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278677 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278677 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.configure_nb_global {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278776 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_fip_distributed_flag {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_network_type_and_physnet {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_ovn_owned_dns_option {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.278992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_ha_failover {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.279035 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.279074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_mac_aging_settings {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.279172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_distributed_flag {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.279274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_static_routes {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.279274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_security_group_with_address_group {{(pid=104932) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 08 13:10:23.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.282659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.283233 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] Maintenance task thread has started
Apr 08 13:10:23.283816 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] MaintenanceWorker process has finished the post initialization
Apr 08 13:10:23.290434 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.294555 np0000164309 neutron-ovn-maintenance-worker[104932]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] New host np0000164309 found in OVN SB DB, but not in Neutron. Add its SegmentHostMapping in Neutron
Apr 08 13:10:23.304189 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.305721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.306143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.311274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c69ffe0c-a826-4ca8-bb8a-5b4238451a33 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:23.312826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.314580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.315216 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.317417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.318871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.322805 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.323786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.327551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 08 13:10:23.329861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.351349 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.353365 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.354757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG oslo_concurrency.lockutils [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] Acquiring lock "update_segment_host_mapping" by "neutron.services.segments.db.update_segment_host_mapping" {{(pid=104932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 13:10:23.367013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG oslo_concurrency.lockutils [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] Lock "update_segment_host_mapping" acquired by "neutron.services.segments.db.update_segment_host_mapping" :: waited 0.012s {{(pid=104932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 13:10:23.383478 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.390953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.391757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:23.392069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.400461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.402452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:23.402452 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.402452 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:23.402452 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.402452 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.402452 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:23.402452 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.402452 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.457677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.458709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:23.464807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:23.469407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.474493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:10:23.500908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:23.509770 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.517975 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.db.ovn_hash_ring_db [None req-a252b680-78c6-44fc-98d0-9d09c1d22c7f None None] Cleaned up Hash Ring nodes older than 5 days
Apr 08 13:10:23.545745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.569977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.575126 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.583472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:23.585026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:23.585026 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.585026 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:23.585026 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.585026 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.585026 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:23.585026 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.585026 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:23.600044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.601084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:23.601084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.601084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:23.601084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.601084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.601084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:23.601084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.601084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' (it runs every 86400.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 916, in configure_nb_global
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:23.606545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.607525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:23.608535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.608535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:23.609956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.611505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron_lib.callbacks.manager [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] Publish callbacks ['neutron.plugins.ml2.plugin.DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments-1563004', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-133726538'] for segment_host_mapping (None), after_create {{(pid=104932) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 08 13:10:23.641551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: No inconsistencies found. Skipping {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:383}}
Apr 08 13:10:23.645948 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.658014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:23.662303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:23.662303 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.662303 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:23.662303 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.662303 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.662303 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:23.662303 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.662303 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:23.672886 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-058aca35-a9f6-4fa8-9e5c-3089fe777329 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.676986 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.696507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in external_ids of LRPs. {{(pid=104932) update_lrouter_ports_ext_ids_name_prefix /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:500}}
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:23.705581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.706509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:23.706509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.706509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:23.706509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.706509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.706509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:23.706509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.706509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:23.714213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:23.718636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.services.segments.db [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] Segments {'83258353-9720-4502-8be2-b82538bb4ee2'} mapped to the host np0000164309 {{(pid=104932) update_segment_host_mapping /opt/stack/neutron/neutron/services/segments/db.py:249}}
Apr 08 13:10:23.723755 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.725966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:23.730785 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-1c111765-aafc-415d-a03d-1b654972ef6c None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:10:23.746513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.747783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.749128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:23.749128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.749128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:23.749128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.749894 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-b85f47cf-4325-4110-ae57-df32e483e6be None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.760554 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.765758 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG oslo_concurrency.lockutils [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] Lock "update_segment_host_mapping" "released" by "neutron.services.segments.db.update_segment_host_mapping" :: held 0.377s {{(pid=104932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 13:10:23.771485 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in LRPs (took 0.05 seconds)
Apr 08 13:10:23.771643 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.771799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:23.771799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.771799 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:23.771799 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.771799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.771799 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:23.771799 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.771799 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:23.774508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' {{(pid=104932) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 08 13:10:23.775944 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] OVN-SB Sync hostname and physical networks completed @ 2026-04-08 13:10:23.767369 {{(pid=104932) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1528}}
Apr 08 13:10:23.777525 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:23.790801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.792090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:23.792090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.792090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:23.792090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.792090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.792090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:23.792090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.792090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:23.796356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:23.809740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.810575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:23.811553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.811553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:23.818590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.851565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-6dc4545e-a810-456a-810b-764e920f8578 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.856900 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-503464b3-7b60-4096-92e0-a95aeaa32575 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.857736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:23.857736 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.857736 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:23.857736 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.857736 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.857736 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:23.857736 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.857736 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.865690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.866701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:23.870965 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:23.872010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-0da53df4-f657-401b-9758-8b127a8d3fd3 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.889494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.890861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-058aca35-a9f6-4fa8-9e5c-3089fe777329 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:23.891416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c69ffe0c-a826-4ca8-bb8a-5b4238451a33 None None] Traceback (most recent call last):
Apr 08 13:10:23.891416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.891416 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:23.891416 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.891416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.891416 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:23.891416 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.891416 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-c69ffe0c-a826-4ca8-bb8a-5b4238451a33 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.895094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:23.896091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:23.990593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-36fc86a4-4b93-4907-b481-674712eca5ed None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:24.048806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [None req-16607b14-97a4-4d0a-aa1f-9c3eb22f4efc None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104932) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 08 13:10:24.330458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5abea502-9f65-4d19-bbdc-93c32eb9c2ee, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:revision_number': '6', 'neutron:router_name': 'neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5 88cc7e33-1b68-4e35-9edc-36247de507c0'}, gateway_chassis=[861dde3e-4494-4eff-8615-64feb231d3e2], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:a6:6f:1b', name='lrp-d01d32b0-3407-4867-bc82-efcb9df3c340', networks=['172.24.5.85/24', '2001:db8::90/64'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=104932) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 08 13:10:24.331857 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=da7892d8-d39a-4a39-904e-e3c35297a796, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'}, gateway_chassis=[861dde3e-4494-4eff-8615-64feb231d3e2], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:a6:6f:1b', name='lrp-d01d32b0-3407-4867-bc82-efcb9df3c340', networks=['172.24.5.85/24'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={'hosting-chassis': 'f9890283-994e-44b6-8937-b9b9f047f9cb'}) old= {{(pid=104932) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 08 13:10:24.333733 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 08 13:10:24.407397 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c synchronized; highest priority chassis f9890283-994e-44b6-8937-b9b9f047f9cb
Apr 08 13:10:24.410419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'neutron:router_id': '8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc'}),), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:24.411628 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, chassis=f9890283-994e-44b6-8937-b9b9f047f9cb, priority=1, columns={}) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:24.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:24.413965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:24.413965 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:24.413965 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:24.413965 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:24.413965 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:24.413965 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:24.413965 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:24.413965 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 89, in run
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     next(self.gen)
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     next(self.gen)
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:24.417253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     raise result.ex
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:24.418404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event 
Apr 08 13:10:24.432176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 08 13:10:24.435534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2524e75a-6eae-4013-a2db-28a49e63a324 None None] OVN-Southbound DB sync process completed @ 2026-04-08 13:10:24.434923 {{(pid=104932) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1482}}
Apr 08 13:10:24.453738 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c synchronized; highest priority chassis f9890283-994e-44b6-8937-b9b9f047f9cb
Apr 08 13:10:24.454606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'neutron:router_id': '8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc'}),), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:24.455594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, chassis=f9890283-994e-44b6-8937-b9b9f047f9cb, priority=1, columns={}) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:24.456015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:24.456962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:24.456962 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:24.456962 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:24.456962 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:24.456962 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:24.456962 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:24.456962 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:24.456962 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 81, in run
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     next(self.gen)
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     next(self.gen)
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:24.458194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     raise result.ex
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:24.459601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event 
Apr 08 13:10:28.308290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:28.310439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:28.343362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:28.343513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.344009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:10:28.344009 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.344009 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:28.344009 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.344009 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.344009 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:28.344009 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.344009 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.344888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.345706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:28.385846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:28.388083 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:28.388347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.389093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:28.389093 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.389093 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:28.389093 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.389093 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.389093 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:28.389093 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.389093 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.391161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.391715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:28.412379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:28.413289 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:10:28.413922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:28.414107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:28.417651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.418476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:10:28.419458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.420115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.420582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:28.420582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.420582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:28.607170 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:28.608130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:28.609513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:28.609818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.610441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:28.610441 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.610441 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:28.610441 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.610441 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.610441 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:28.610441 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.610441 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:28.611787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:28.612594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:28.612594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.612594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:28.612594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.612594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.612594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:28.612594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.612594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:28.613927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.614756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:28.615758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.615758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:28.697388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:28.698380 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:28.699019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:28.699429 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:28.699647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.700524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:28.700524 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.700524 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:28.700524 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.700524 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.700524 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:28.700524 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.700524 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.702178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:28.702767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:33.309379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:33.311777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:33.344843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:33.345376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.346330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:10:33.346330 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.346330 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:33.346330 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.346330 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.346330 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:33.346330 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.346330 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.347642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.348442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:33.387808 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:33.389256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:33.389634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.391279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:33.391279 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.391279 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:33.391279 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.391279 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.391279 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:33.391279 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.391279 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.392533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.393337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:33.413291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:33.414201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:10:33.414661 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:33.414976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.415811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:33.415811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.415811 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:33.415811 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.415811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.415811 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:33.415811 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.415811 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:33.417076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:33.417928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:33.417928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.417928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:33.417928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.417928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.417928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:33.417928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.417928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:10:33.418641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.419463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.420386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:33.420386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.420386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:33.608407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:33.609377 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:33.610212 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:33.611047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.612480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:33.612480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.612480 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:33.612480 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.612480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.612480 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:33.612480 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.612480 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:33.614053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:33.614925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:33.614925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.614925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:33.614925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.614925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.614925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:33.614925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.614925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:33.615900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.617079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:33.617949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.617949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:33.698417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:33.699463 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:33.700157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:33.700553 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:33.700812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.701648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:33.701648 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.701648 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:33.701648 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.701648 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.701648 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:33.701648 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.701648 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.703435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:33.704045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:38.310388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:38.312549 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:38.343865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:38.344085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.344652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:10:38.344652 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.344652 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:38.344652 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.344652 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.344652 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:38.344652 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.344652 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.345512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.345897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:38.389010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:38.390285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:38.390506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.392043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:38.392761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.393314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.393314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:38.393314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.393314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:38.414270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:38.414977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:10:38.415467 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:38.415887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.418045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:38.418045 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.418045 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:38.418045 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.418045 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.418045 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:38.418045 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.418045 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:38.418867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:38.419767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:38.419767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.419767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:38.419767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.419767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.419767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:38.419767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.419767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:10:38.420158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.421055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.421902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:38.421902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.421902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:38.609457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:38.610923 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:38.611378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:38.611800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:38.615522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.616446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:38.616903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.617488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:38.699550 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:38.700469 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:38.700998 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:38.701405 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:38.701604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.702719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:38.702719 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.702719 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:38.702719 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.702719 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.702719 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:38.702719 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.702719 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.704918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:38.705796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:43.311367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:43.314414 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:43.355178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:43.355586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Traceback (most recent call last):
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:43.357463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:43.357883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.358317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:43.358317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.358317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.358317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:43.358317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.358317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:43.390061 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:43.391810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:43.392188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.393116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:43.393116 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.393116 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:43.393116 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.393116 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.393116 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:43.393116 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.393116 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.395047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.395801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:43.415136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:43.416073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:10:43.416636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:43.416975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.417692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:43.417692 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.417692 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:43.417692 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.417692 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.417692 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:43.417692 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.417692 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:43.418852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:43.419681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:43.419681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.419681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:43.419681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.419681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.419681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:43.419681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.419681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:10:43.420460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.421282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.422121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:43.422121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.422121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:43.610882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:43.612179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:43.612653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:43.612891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.613444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:43.613444 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.613444 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:43.613444 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.613444 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.613444 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:43.613444 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.613444 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:43.614772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:43.615080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:43.615080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.615080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:43.615080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.615080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.615080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:43.615080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.615080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:43.616345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.616681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:43.617030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.617030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:43.700705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:43.701898 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:43.702488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:43.702900 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:43.703083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.703870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:43.703870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.703870 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:43.703870 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.703870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.703870 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:43.703870 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.703870 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.705580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:43.706570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:48.312960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:48.315764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:48.344153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:48.344753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.345946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:10:48.345946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.345946 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:48.345946 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.345946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.345946 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:48.345946 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.345946 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.346981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.347512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:48.392389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:48.393857 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:48.394172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.395112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:48.395112 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.395112 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:48.395112 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.395112 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.395112 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:48.395112 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.395112 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.396461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.397013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:48.419162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:48.419576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:10:48.420409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:48.420800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.421557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:48.421557 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.421557 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:48.421557 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.421557 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.421557 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:48.421557 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.421557 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:48.422864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:48.423394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:48.423394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.423394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:48.423394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.423394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.423394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:48.423394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.423394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:10:48.424629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.425058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.425426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:48.425426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.425426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:48.612572 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:48.614081 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:48.614967 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:48.615389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.616274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:48.616274 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.616274 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:48.616274 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.616274 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.616274 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:48.616274 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.616274 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:48.617673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:48.618392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:48.618392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.618392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:48.618392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.618392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.618392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:48.618392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.618392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:48.619539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.620675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:48.621637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.621637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:48.702268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:48.703705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:48.704192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:48.704551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:48.704715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.705434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:48.705434 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.705434 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:48.705434 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.705434 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.705434 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:48.705434 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.705434 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.706633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:48.707157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:53.314664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:53.317456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:53.357409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:53.358076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.361070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:10:53.361070 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.361070 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:53.361070 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.361070 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.361070 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:53.361070 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.361070 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.362039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.362366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:53.393286 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:53.394957 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:53.395321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.396260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:53.396260 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.396260 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:53.396260 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.396260 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.396260 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:53.396260 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.396260 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.398081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.398542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:53.419659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:53.420986 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:10:53.421708 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:53.422040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.422857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:53.422857 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.422857 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:53.422857 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.422857 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.422857 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:53.422857 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.422857 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:53.424243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:53.424710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:53.424710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.424710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:53.424710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.424710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.424710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:53.424710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.424710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:10:53.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.426216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.426703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:53.426703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.426703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:53.614146 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:53.615040 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:53.615447 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:53.615851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.616423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:53.616423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.616423 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:53.616423 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.616423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.616423 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:53.616423 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.616423 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:53.617481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:53.618164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:53.618164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.618164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:53.618164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.618164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.618164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:53.618164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.618164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:53.619250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.619995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:53.620850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.620850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:53.703696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:53.704811 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:53.705309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:53.705713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:53.705902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.706839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:53.706839 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.706839 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:53.706839 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.706839 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.706839 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:53.706839 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.706839 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.708260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:53.708589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:58.315645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:58.319277 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:58.349849 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:58.349849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.350585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:10:58.350585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.350585 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:58.350585 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.350585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.350585 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:58.350585 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.350585 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.351636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.353295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:58.394271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:58.399120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:58.400773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.401248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:58.421305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:58.422172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:10:58.422545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:58.422814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:58.424954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.425348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.425683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.426055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:58.615271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:58.616472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:58.617463 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:58.617918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:10:58.621662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.622664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:10:58.623391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.624250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:58.625071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.625071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:10:58.704825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:10:58.705864 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:10:58.706340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:58.706569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:10:58.706713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.707523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:10:58.707523 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.707523 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:10:58.707523 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.707523 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.707523 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:10:58.707523 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.707523 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.710047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:10:58.710956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:03.317030 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:03.319362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:03.358841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:03.359211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.360126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:11:03.360126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.360126 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:03.360126 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.360126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.360126 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:03.360126 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.360126 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.361161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.361548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:03.396053 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:03.397676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:03.398006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.399012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:03.399012 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.399012 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:03.399012 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.399012 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.399012 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:03.399012 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.399012 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.400331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.401185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:03.422489 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:03.423531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:03.424304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:03.424641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.425531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:03.425531 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.425531 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:03.425531 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.425531 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.425531 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:03.425531 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.425531 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:03.427065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:03.428180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:03.428180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.428180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:03.428180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.428180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.428180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:03.428180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.428180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:03.429428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.430400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.431688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:03.431688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.431688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:03.616875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:03.617658 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:03.618354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:03.618801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.619592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:03.619592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.619592 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:03.619592 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.619592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.619592 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:03.619592 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.619592 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:03.620886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:03.621698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:03.621698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.621698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:03.621698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.621698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.621698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:03.621698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.621698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:03.622464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.623198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:03.624089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.624089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:03.706035 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:03.706980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:03.707604 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:03.708071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:03.708282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.709086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:03.709086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.709086 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:03.709086 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.709086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.709086 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:03.709086 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.709086 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.710916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:03.711929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:08.319015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:08.328321 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:08.360314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:08.360588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.361683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Traceback (most recent call last):
Apr 08 13:11:08.361683 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.361683 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:08.361683 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.361683 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.361683 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:08.361683 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.361683 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.362128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.362783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:08.397184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:08.399215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:08.399570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.400692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:08.400692 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.400692 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:08.400692 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.400692 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.400692 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:08.400692 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.400692 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.403657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.404422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:08.424028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:08.424943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:08.425462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:08.425829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.426545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:08.426545 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.426545 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:08.426545 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.426545 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.426545 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:08.426545 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.426545 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:08.427932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:08.428686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:08.428686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.428686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:08.428686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.428686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.428686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:08.428686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.428686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:08.429395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.430166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.430991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:08.430991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.430991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:08.617994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:08.619160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:08.619996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:08.620559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.621305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:08.621305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.621305 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:08.621305 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.621305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.621305 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:08.621305 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.621305 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:08.622641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:08.623089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:08.623089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.623089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:08.623089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.623089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.623089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:08.623089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.623089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:08.624308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.624839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:08.625302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.625302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:08.707279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:08.708751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:08.709572 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:08.710049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:08.710255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.711234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:08.711234 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.711234 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:08.711234 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.711234 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.711234 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:08.711234 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.711234 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.713359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:08.714217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:13.324278 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:13.326269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:13.328010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=557,neutron:DELETE=1,neutron:INSERT=1,neutron:UPDATE=2 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:11:13.362297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:13.362843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.364016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Traceback (most recent call last):
Apr 08 13:11:13.364016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.364016 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:13.364016 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.364016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.364016 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:13.364016 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.364016 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.365395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.366056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:13.398571 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:13.400430 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:13.400804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.401641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:13.401641 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.401641 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:13.401641 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.401641 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.401641 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:13.401641 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.401641 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.403457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.404514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:13.425015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:13.426039 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:13.426866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:13.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.428257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:13.428257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.428257 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:13.428257 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.428257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.428257 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:13.428257 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.428257 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:13.429972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:13.431088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:13.431088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.431088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:13.431088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.431088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.431088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:13.431088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.431088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:13.431577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.432566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.433709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:13.433709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.433709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:13.619369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:13.620396 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:13.621435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:13.621774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.622505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:13.622505 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.622505 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:13.622505 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.622505 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.622505 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:13.622505 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.622505 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:13.624062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:13.624516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:13.624516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.624516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:13.624516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.624516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.624516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:13.624516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.624516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:13.626032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.626461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:13.627004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.627004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:13.709168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:13.711298 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:13.712060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:13.712474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:13.712699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.713738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:13.713738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.713738 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:13.713738 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.713738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.713738 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:13.713738 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.713738 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.715900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:13.716697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:18.325601 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:18.327935 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:18.361125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:18.361717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.362717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:11:18.362717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.362717 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:18.362717 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.362717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.362717 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:18.362717 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.362717 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.363952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.364823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:18.399871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:18.401242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:18.401413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.402002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:18.402002 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.402002 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:18.402002 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.402002 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.402002 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:18.402002 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.402002 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.403880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.404870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:18.426064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:18.427251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:18.427905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:18.427905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.428376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:18.428376 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.428376 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:18.428376 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.428376 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.428376 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:18.428376 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.428376 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:18.429709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.431141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:18.431808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.432663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:18.620874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:18.621958 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:18.622562 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:18.623098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.624103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:18.624103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.624103 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:18.624103 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.624103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.624103 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:18.624103 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.624103 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:18.625682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:18.626695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:18.626695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.626695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:18.626695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.626695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.626695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:18.626695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.626695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:18.627408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.628134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:18.629821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.629821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.718302 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:18.718867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:18.719524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:23.326993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:23.329021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:23.362300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:23.362790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.363939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:11:23.363939 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.363939 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:23.363939 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.363939 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.363939 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:23.363939 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.363939 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.365148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.366063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:23.401090 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:23.402564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:23.402944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.403754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:23.403754 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.403754 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:23.403754 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.403754 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.403754 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:23.403754 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.403754 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.405440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.406344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:23.427431 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:23.427910 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:23.428605 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:23.428907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.429773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:23.429773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.429773 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:23.429773 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.429773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.429773 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:23.429773 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.429773 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:23.431320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:23.432468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:23.432468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.432468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:23.432468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.432468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.432468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:23.432468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.432468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:23.433694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.434853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.435742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:23.435742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.435742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:23.621752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:23.622187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:23.622667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:23.622938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.623448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:23.623448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.623448 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:23.623448 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.623448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.623448 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:23.623448 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.623448 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:23.624256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.625324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:23.626331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.627588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:23.712009 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:23.712601 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:23.713257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:23.713646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:23.713908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.714772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:23.714772 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.714772 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:23.714772 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.714772 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.714772 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:23.714772 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.714772 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.716599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:23.717363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:28.329281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:28.330932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:28.372023 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:28.372455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.373555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:11:28.373555 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.373555 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:28.373555 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.373555 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.373555 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:28.373555 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.373555 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.374703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.375567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:28.402661 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:28.403939 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:28.404346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.405264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:28.405264 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.405264 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:28.405264 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.405264 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.405264 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:28.405264 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.405264 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.407134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.408511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:28.428004 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:28.428814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:28.429841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:28.430214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.431051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:28.431051 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.431051 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:28.431051 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.431051 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.431051 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:28.431051 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.431051 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:28.432543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:28.433705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:28.433705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.433705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:28.433705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.433705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.433705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:28.433705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.433705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:28.434301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.435447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.436200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:28.436200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.436200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:28.622539 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:28.623235 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:28.624178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:28.624590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.625494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:28.625494 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.625494 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:28.625494 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.625494 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.625494 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:28.625494 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.625494 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:28.627158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:28.627914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:28.627914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.627914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:28.627914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.627914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.627914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:28.627914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.627914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:28.628911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.629691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:28.630575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.630575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:28.712820 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:28.713369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:28.713996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:28.714557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:28.714854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.715755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:28.715755 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.715755 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:28.715755 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.715755 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.715755 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:28.715755 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.715755 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.717509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:28.718395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:33.330035 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:33.332406 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-617f0377-c2f3-4caa-bc26-d595111bcc4b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:33.364934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:33.365188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.365669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-617f0377-c2f3-4caa-bc26-d595111bcc4b None None] Traceback (most recent call last):
Apr 08 13:11:33.365669 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.365669 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:33.365669 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.365669 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.365669 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:33.365669 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.365669 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-617f0377-c2f3-4caa-bc26-d595111bcc4b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.366482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.367614 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:33.403447 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:33.404434 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:33.404744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.405399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:33.405399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.405399 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:33.405399 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.405399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.405399 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:33.405399 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.405399 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.407149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.407860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:33.428563 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:33.429112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:33.429848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:33.430273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.431202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:33.431202 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.431202 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:33.431202 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.431202 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.431202 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:33.431202 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.431202 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:33.432487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:33.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:33.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:33.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:33.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:33.434529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.435177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:33.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:33.623339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:33.623918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:33.624935 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:33.625510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.626565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:33.626565 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.626565 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:33.626565 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.626565 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.626565 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:33.626565 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.626565 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:33.627939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:33.628519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:33.628519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.628519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:33.628519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.628519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.628519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:33.628519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.628519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:33.629714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.630200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:33.630735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.630735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:33.713558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:33.714204 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:33.715004 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:33.715409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:33.715629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.716671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:33.716671 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.716671 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:33.716671 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.716671 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.716671 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:33.716671 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.716671 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.718508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:33.719261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:38.331712 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:38.333665 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:38.369631 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:38.369915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.370774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:11:38.370774 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.370774 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:38.370774 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.370774 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.370774 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:38.370774 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.370774 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.371764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.372155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:38.404242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:38.405365 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:38.405726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.406792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:38.406792 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.406792 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:38.406792 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.406792 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.406792 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:38.406792 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.406792 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.409108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.410208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:38.429205 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:38.429415 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:38.430013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:38.430310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.431011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:38.431011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.431011 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:38.431011 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.431011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.431011 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:38.431011 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.431011 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:38.431928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:38.432700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:38.432700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.432700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:38.432700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.432700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.432700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:38.432700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.432700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:38.433081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.433795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.434572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:38.434572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.434572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:38.624508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:38.624977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:38.625508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:38.625932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.626795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:38.626795 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.626795 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:38.626795 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.626795 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.626795 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:38.626795 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.626795 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:38.628410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:38.629159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:38.629159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.629159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:38.629159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.629159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.629159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:38.629159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.629159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:38.630680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.631648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:38.632198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.632198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:38.714365 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:38.714917 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:38.715715 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:38.716192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:38.716422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.717290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:38.717290 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.717290 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:38.717290 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.717290 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.717290 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:38.717290 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.717290 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:38.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:43.332637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:43.333500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:43.362708 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:43.363055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.363958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:11:43.363958 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.363958 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:43.363958 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.363958 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.363958 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:43.363958 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.363958 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.365232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.366211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:43.404750 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:43.405751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:43.406036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.406920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:43.406920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.406920 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:43.406920 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.406920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.406920 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:43.406920 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.406920 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.409100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.409919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:43.429538 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:43.429819 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:43.430194 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:43.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.431344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:43.431344 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.431344 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:43.431344 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.431344 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.431344 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:43.431344 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.431344 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:43.432919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:43.433788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:43.433788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.433788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:43.433788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.433788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.433788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:43.433788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.433788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:43.434435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.435248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.436151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:43.436151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.436151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:43.625311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:43.625497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:43.626237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:43.626644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.627454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:43.627454 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.627454 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:43.627454 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.627454 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.627454 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:43.627454 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.627454 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:43.628804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:43.629579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:43.629579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.629579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:43.629579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.629579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.629579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:43.629579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.629579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:43.630435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.631190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:43.632450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.632450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:43.715007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:43.715798 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:43.716199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:43.716525 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:43.716736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.719245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:43.720119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:43.720971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:43.720971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:43.720971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:43.720971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:48.333492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:48.334727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:48.368974 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Traceback (most recent call last):
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.453108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:48.453971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:48.454891 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.455549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.456356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.457139 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:48.457752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.458456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:48.459154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.460168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:48.625817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:48.626200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:48.627014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:48.627422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.628351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:48.628351 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.628351 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:48.628351 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.628351 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.628351 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:48.628351 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.628351 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:48.629713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:48.630425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:48.630425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.630425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:48.630425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.630425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.630425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:48.630425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.630425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:48.631302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.632128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:48.633082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.633082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:48.715703 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:48.716413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:48.717005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:48.717367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:48.717529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.718416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:48.718416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.718416 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:48.718416 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.718416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.718416 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:48.718416 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.718416 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.720526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:48.721173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:53.334043 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:53.335862 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:53.369679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:53.370076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:11:53.370926 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.370926 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:53.370926 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.370926 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.370926 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:53.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.380407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:53.406968 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:53.413162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:53.413468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.414419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:53.414419 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.414419 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:53.414419 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.414419 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.414419 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:53.414419 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.414419 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.416732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.417556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:53.430575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:53.431096 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:53.431600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:53.431914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.432703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:53.432703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.432703 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:53.432703 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.432703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.432703 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:53.432703 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.432703 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:53.434042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:53.434993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:53.434993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.434993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:53.434993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.434993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.434993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:53.434993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.434993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:53.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.436583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.437422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:53.437422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.437422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:53.626533 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:53.627049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:53.627839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:53.628265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.629187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:53.629187 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.629187 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:53.629187 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.629187 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.629187 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:53.629187 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.629187 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:53.630514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:53.631182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:53.631182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.631182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:53.631182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.631182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.631182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:53.631182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.631182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:53.632108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.632846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:53.633659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.633659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:53.716238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:53.716934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:53.717403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:53.717779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:53.717947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.718773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:53.718773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.718773 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:53.718773 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.718773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.718773 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:53.718773 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.718773 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.720368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:53.721242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:58.334992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:58.336143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:58.375539 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:58.376054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.377229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:11:58.377229 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.377229 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:58.377229 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.377229 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.377229 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:58.377229 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.377229 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.378432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.379509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:58.412322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:58.413343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:58.413904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.415061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:58.415061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.415061 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:58.415061 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.415061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.415061 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:58.415061 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.415061 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.417074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.417486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:58.431199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:58.431713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:11:58.432256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:58.432525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.433249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:58.433249 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.433249 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:58.433249 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.433249 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.433249 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:58.433249 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.433249 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:58.434713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:58.435155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:58.435155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.435155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:58.435155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.435155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.435155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:58.435155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.435155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:11:58.436588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.437000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.437425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:58.437425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.437425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:58.627204 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:58.627824 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:58.628767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:58.629214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.630172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:58.630172 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.630172 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:58.630172 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.630172 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.630172 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:58.630172 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.630172 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:11:58.631492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:58.632166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:11:58.632166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.632166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:11:58.632166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.632166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.632166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:11:58.632166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.632166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:11:58.633127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.633864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:58.634836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.634836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:11:58.716901 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:11:58.717452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:11:58.717961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:58.718335 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:11:58.718595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.719361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:11:58.719361 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.719361 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:11:58.719361 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.719361 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.719361 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:11:58.719361 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.719361 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.721250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:11:58.721723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:03.335562 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:03.337039 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:03.373202 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:03.373633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.374629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Traceback (most recent call last):
Apr 08 13:12:03.374629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.374629 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:03.374629 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.374629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.374629 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:03.374629 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.374629 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.376386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.377226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:03.412845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:03.414380 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:03.414809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.416047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:03.416047 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.416047 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:03.416047 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.416047 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.416047 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:03.416047 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.416047 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.417850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.418698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:03.431559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:03.432120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:03.432693 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:03.433009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.433727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:03.433727 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.433727 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:03.433727 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.433727 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.433727 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:03.433727 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.433727 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:03.435100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:03.435593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:03.435593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.435593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:03.435593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.435593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.435593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:03.435593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.435593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:03.436603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.437087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.437674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:03.437674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.437674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:03.627913 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:03.628464 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:03.629348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:03.629746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.630611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:03.630611 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.630611 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:03.630611 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.630611 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.630611 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:03.630611 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.630611 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:03.632012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:03.632440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:03.632440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.632440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:03.632440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.632440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.632440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:03.632440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.632440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:03.633900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.634365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:03.634924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.634924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:03.717753 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:03.718305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:03.719256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:03.719754 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:03.719953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.720793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:03.720793 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.720793 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:03.720793 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.720793 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.720793 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:03.720793 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.720793 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.722397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:03.723198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:08.336253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:08.337678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:08.373241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:08.373443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.374101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:12:08.374101 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.374101 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:08.374101 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.374101 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.374101 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:08.374101 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.374101 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.375933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.377134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:08.413499 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:08.414771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:08.415132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.416084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:08.416084 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.416084 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:08.416084 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.416084 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.416084 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:08.416084 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.416084 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.418010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.419074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:08.432119 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:08.432486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:08.433063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:08.433442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.434335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:08.434335 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.434335 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:08.434335 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.434335 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.434335 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:08.434335 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.434335 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:08.435533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:08.436433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:08.436433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.436433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:08.436433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.436433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.436433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:08.436433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.436433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:08.437040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.438681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:08.438681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.438681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:08.628576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:08.629106 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:08.629943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:08.630471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.631339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:08.631339 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.631339 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:08.631339 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.631339 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.631339 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:08.631339 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.631339 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:08.632958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:08.634011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:08.634011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.634011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:08.634011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.634011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.634011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:08.634011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.634011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:08.634372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.635384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:08.636194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.636194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:08.718444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:08.718932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:08.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:08.719819 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:08.719944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.720584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:08.720584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.720584 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:08.720584 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.720584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.720584 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:08.720584 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.720584 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.722342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:08.723167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:13.336922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:13.338337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:13.358882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=250 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:12:13.372529 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:13.373025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.373841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Traceback (most recent call last):
Apr 08 13:12:13.373841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.373841 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:13.373841 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.373841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.373841 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:13.373841 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.373841 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.374737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.375593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:13.413918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:13.415010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:13.415398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.416531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:13.416531 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.416531 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:13.416531 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.416531 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.416531 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:13.416531 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.416531 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.418443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.419312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:13.432627 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:13.433092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:13.433664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:13.434022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:13.436124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:13.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:13.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:13.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:13.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:13.437865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.438521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.439363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:13.439363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.439363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:13.629383 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:13.630079 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:13.630954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:13.631441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.632412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:13.632412 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.632412 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:13.632412 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.632412 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.632412 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:13.632412 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.632412 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:13.633985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:13.634722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:13.634722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.634722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:13.634722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.634722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.634722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:13.634722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.634722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:13.635639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.636384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:13.637334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.637334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:13.719218 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:13.719886 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:13.720592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:13.720980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:13.721149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.721972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:13.721972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.721972 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:13.721972 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.721972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.721972 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:13.721972 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.721972 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.723722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:13.724549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:18.337756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:18.339239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:18.376524 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:18.376977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.378042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Traceback (most recent call last):
Apr 08 13:12:18.378042 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.378042 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:18.378042 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.378042 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.378042 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:18.378042 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.378042 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.380329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.381310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:18.414825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:18.415731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:18.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.416766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:18.416766 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.416766 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:18.416766 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.416766 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.416766 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:18.416766 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.416766 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.418763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.419759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:18.433077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:18.433581 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:18.434143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:18.434493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.435186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:18.435186 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.435186 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:18.435186 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.435186 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.435186 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:18.435186 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.435186 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:18.436053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:18.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:18.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:18.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:18.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.436809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:18.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.437874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.438750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:18.438750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.438750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:18.630053 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:18.630445 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:18.631220 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:18.631609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.632443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:18.632443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.632443 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:18.632443 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.632443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.632443 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:18.632443 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.632443 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:18.633797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:18.634547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:18.634547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.634547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:18.634547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.634547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.634547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:18.634547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.634547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:18.635456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.636443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:18.637313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.637313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:18.719814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:18.720176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:18.720689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:18.721097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:18.721295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.722801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:18.722801 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.722801 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:18.722801 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.722801 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.722801 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:18.722801 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.722801 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.723335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:18.724702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:23.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:23.340269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:23.366719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:23.367004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.367664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:12:23.367664 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.367664 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:23.367664 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.367664 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.367664 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:23.367664 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.367664 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.368635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.369317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:23.415472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:23.416700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:23.417052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.418578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:23.418578 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.418578 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:23.418578 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.418578 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.418578 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:23.418578 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.418578 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.420344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:23.433683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:23.434106 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:23.434508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:23.434726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.435225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:23.435225 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.435225 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:23.435225 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.435225 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.435225 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:23.435225 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.435225 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:23.436445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:23.437177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:23.437177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.437177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:23.437177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.437177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.437177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:23.437177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.437177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:23.438140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.439646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.440711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:23.440711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.440711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:23.630725 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:23.631242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:23.632181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:23.632583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.633351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:23.633351 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.633351 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:23.633351 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.633351 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.633351 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:23.633351 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.633351 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:23.636406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.636705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:23.637027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.637372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:23.720324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:23.721102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:23.721565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:23.721960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:23.722146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.723047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:23.723047 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.723047 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:23.723047 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.723047 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.723047 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:23.723047 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.723047 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.724814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:23.725559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:28.338979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:28.340577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:28.373860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:28.374255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.375140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:12:28.375140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.375140 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:28.375140 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.375140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.375140 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:28.375140 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.375140 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.376065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.376712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:28.416130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:28.417067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:28.417437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.418282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:28.418282 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.418282 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:28.418282 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.418282 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.418282 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:28.418282 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.418282 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.420787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.421518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:28.434160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:28.434703 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:28.435096 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:28.435322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.436067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:28.436067 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.436067 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:28.436067 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.436067 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.436067 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:28.436067 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.436067 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:28.437322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:28.438141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:28.438141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.438141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:28.438141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.438141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.438141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:28.438141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.438141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:28.438857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.439580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.440081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:28.440081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.440081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:28.631279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:28.631588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:28.632348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:28.632987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.633822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:28.633822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.633822 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:28.633822 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.633822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.633822 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:28.633822 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.633822 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:28.635136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:28.635851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:28.635851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.635851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:28.635851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.635851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.635851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:28.635851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.635851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:28.636763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.637497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:28.638348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.638348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:28.720945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:28.721529 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:28.721924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:28.722173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:28.722269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.722826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:28.722826 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.722826 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:28.722826 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.722826 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.722826 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:28.722826 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.722826 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.724514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:28.725420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:33.339652 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:33.341385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:33.372596 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:33.372925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.373839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:12:33.373839 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.373839 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:33.373839 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.373839 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.373839 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:33.373839 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.373839 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.375786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.376549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:33.416742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:33.417605 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:33.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.418778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:33.418778 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.418778 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:33.418778 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.418778 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.418778 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:33.418778 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.418778 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.419952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.420696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:33.434639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:33.435135 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:33.435719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:33.436023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.436811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:33.436811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.436811 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:33.436811 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.436811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.436811 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:33.436811 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.436811 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:33.438046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:33.438807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:33.438807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.438807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:33.438807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.438807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.438807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:33.438807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.438807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:33.439548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.441164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:33.441164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.441164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:33.631945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:33.632577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:33.633250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:33.633520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.634145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:33.634145 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.634145 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:33.634145 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.634145 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.634145 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:33.634145 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.634145 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:33.634955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:33.635704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:33.635704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.635704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:33.635704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.635704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.635704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:33.635704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.635704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:33.636025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.637308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:33.638105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.638105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:33.721543 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:33.722099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:33.722742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:33.723187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:33.723445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.724263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:33.724263 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.724263 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:33.724263 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.724263 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.724263 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:33.724263 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.724263 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.725968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:33.726730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:38.340412 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:38.342071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:38.375656 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:38.375916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.376585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:12:38.376585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.376585 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:38.376585 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.376585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.376585 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:38.376585 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.376585 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.377497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.378081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:38.417414 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:38.418431 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:38.418962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.419764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:38.419764 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.419764 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:38.419764 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.419764 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.419764 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:38.419764 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.419764 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.421446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.422739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:38.435111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:38.435438 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:38.436012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:38.436346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.437026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:38.437026 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.437026 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:38.437026 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.437026 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.437026 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:38.437026 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.437026 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:38.438188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:38.439016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:38.439016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.439016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:38.439016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.439016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.439016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:38.439016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.439016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:38.439744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.440433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.441265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:38.441265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.441265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:38.632833 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:38.633182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:38.633631 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:38.634038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.634865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:38.634865 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.634865 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:38.634865 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.634865 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.634865 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:38.634865 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.634865 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:38.636116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:38.636844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:38.636844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.636844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:38.636844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.636844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.636844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:38.636844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.636844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:38.637735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.638368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:38.639124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.639124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:38.722147 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:38.722724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:38.723349 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:38.723747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:38.723939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.724666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:38.724666 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.724666 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:38.724666 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.724666 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.724666 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:38.724666 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.724666 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.726627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:38.727502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:43.341150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:43.356794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:43.391435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:43.391854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.392865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:12:43.392865 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.392865 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:43.392865 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.392865 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.392865 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:43.392865 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.392865 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.394877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.395844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:43.417937 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:43.419016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:43.419313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:43.420200 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.420200 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:43.420200 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.420200 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.420200 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:43.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.422227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.423035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:43.435530 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:43.435889 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:43.436398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:43.436705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.437363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:43.437363 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.437363 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:43.437363 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.437363 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.437363 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:43.437363 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.437363 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:43.438637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.440378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:43.441085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.442319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:43.633411 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:43.633808 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:43.634348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:43.634773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.635495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:43.635495 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.635495 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:43.635495 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.635495 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.635495 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:43.635495 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.635495 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:43.636607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:43.637976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:43.637976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.637976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:43.637976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.637976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.637976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:43.637976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.637976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:43.638667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:43.640488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.640488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:43.722732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.726505 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.727459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:43.729193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:48.356238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:48.357892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:48.391318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:48.392046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.393248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:12:48.393248 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.393248 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:48.393248 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.393248 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.393248 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:48.393248 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.393248 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.394748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.395248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:48.418591 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:48.419890 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:48.420244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.421230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:48.421230 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.421230 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:48.421230 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.421230 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.421230 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:48.421230 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.421230 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.423124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.423856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:48.436052 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:48.436386 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:48.437155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:48.437460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.438315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:48.438315 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.438315 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:48.438315 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.438315 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.438315 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:48.438315 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.438315 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:48.439645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:48.440552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:48.440552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.440552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:48.440552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.440552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.440552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:48.440552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.440552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:48.441975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.442443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.442926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:48.442926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.442926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:48.634044 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:48.634570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:48.635385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:48.635863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.636879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:48.636879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.636879 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:48.636879 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.636879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.636879 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:48.636879 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.636879 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:48.638187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:48.638940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:48.638940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.638940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:48.638940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.638940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.638940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:48.638940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.638940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:48.639784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.640463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:48.641406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.641406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:48.723089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:48.723587 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:48.724348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:48.724789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:48.724963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.725847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:48.725847 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.725847 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:48.725847 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.725847 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.725847 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:48.725847 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.725847 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.727806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:48.728662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:53.356988 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:53.358501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:53.391474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:53.391869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.392703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:12:53.392703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.392703 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:53.392703 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.392703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.392703 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:53.392703 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.392703 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.393788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.394579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:53.419326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:53.420335 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:53.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.421410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:53.421410 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.421410 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:53.421410 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.421410 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.421410 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:53.421410 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.421410 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.423336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.424196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:53.436509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:53.436833 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:53.437347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:53.437602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.438282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:53.438282 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.438282 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:53.438282 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.438282 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.438282 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:53.438282 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.438282 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:53.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:53.440258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:53.440258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.440258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:53.440258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.440258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.440258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:53.440258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.440258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:53.440941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.441716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.442516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:53.442516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.442516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:53.635413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:53.635916 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:53.636594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:53.637145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.637857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:53.637857 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.637857 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:53.637857 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.637857 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.637857 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:53.637857 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.637857 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:53.639283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:53.640646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:53.640646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.640646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:53.640646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.640646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.640646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:53.640646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.640646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:53.640905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.641465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:53.642005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.642005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:53.723588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:53.724269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:53.724809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:53.725090 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:53.725218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.725886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:53.725886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.725886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:53.725886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.725886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.725886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:53.725886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.725886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.727524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:53.728496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:58.357713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:58.359491 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:58.392947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:58.393195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.394090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:12:58.394090 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.394090 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:58.394090 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.394090 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.394090 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:58.394090 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.394090 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.395059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.395522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:58.419760 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:58.420604 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:58.420813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.421629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:58.421629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.421629 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:58.421629 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.421629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.421629 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:58.421629 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.421629 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.423039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.423545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:58.436890 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:58.437234 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:12:58.437750 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:58.438037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.438841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:58.438841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.438841 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:58.438841 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.438841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.438841 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:58.438841 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.438841 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:58.440001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:58.440738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:58.440738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.440738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:58.440738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.440738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.440738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:58.440738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.440738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:12:58.441447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.443184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:58.443184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.443184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:58.636162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:58.636501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:58.637214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:58.637601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.638413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:58.638413 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.638413 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:58.638413 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.638413 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.638413 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:58.638413 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.638413 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:12:58.639291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:58.640008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:12:58.640008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.640008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:12:58.640008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.640008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.640008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:12:58.640008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.640008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:12:58.640357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.641078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:58.641948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.641948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:12:58.724242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:12:58.724917 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:12:58.725441 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:58.725700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:12:58.725780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.726346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:12:58.726346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.726346 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:12:58.726346 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.726346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.726346 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:12:58.726346 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.726346 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.728133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:12:58.729035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:03.358440 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:03.360227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:03.391166 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:03.391829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.393098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Traceback (most recent call last):
Apr 08 13:13:03.393098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.393098 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:03.393098 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.393098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.393098 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:03.393098 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.393098 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.394309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.395097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:03.420339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:03.421301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:03.421631 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.422422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:03.422422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.422422 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:03.422422 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.422422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.422422 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:03.422422 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.422422 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.424223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.425021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:03.437357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:03.438019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:03.438479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:03.438772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.439417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:03.439417 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.439417 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:03.439417 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.439417 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.439417 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:03.439417 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.439417 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:03.440680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:03.441457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:03.441457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.441457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:03.441457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.441457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.441457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:03.441457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.441457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:03.442138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.442920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.443761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:03.443761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.443761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:03.636609 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:03.637138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:03.637897 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:03.638638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.639288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:03.639288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.639288 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:03.639288 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.639288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.639288 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:03.639288 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.639288 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:03.640470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:03.640785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:03.640785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.640785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:03.640785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.640785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.640785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:03.640785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.640785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:03.642169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.643252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:03.644095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.644095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:03.725368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:03.726120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:03.726722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:03.727160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:03.727377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.728191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:03.728191 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.728191 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:03.728191 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.728191 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.728191 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:03.728191 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.728191 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.730383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:03.731081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:08.359374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:08.360850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:08.394523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:08.394915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:13:08.396041 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.396041 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:08.396041 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.396041 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.396041 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:08.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.397289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.398200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:08.420934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:08.421931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:08.422270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.423249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:08.423249 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.423249 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:08.423249 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.423249 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.423249 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:08.423249 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.423249 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.424979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.425800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:08.437978 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:08.438342 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:08.439004 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:08.439295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.440076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:08.440076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.440076 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:08.440076 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.440076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.440076 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:08.440076 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.440076 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:08.441342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:08.442485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:08.442485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.442485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:08.442485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.442485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.442485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:08.442485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.442485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:08.443046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.443852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.444743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:08.444743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.444743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:08.637663 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:08.637991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:08.638646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:08.639024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.639941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:08.639941 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.639941 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:08.639941 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.639941 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.639941 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:08.639941 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.639941 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:08.641269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:08.642082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:08.642082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.642082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:08.642082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.642082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.642082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:08.642082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.642082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:08.643259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.644164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:08.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:08.725996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:08.726486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:08.727047 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:08.727426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:08.727606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.728320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:08.728320 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.728320 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:08.728320 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.728320 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.728320 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:08.728320 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.728320 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.729990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:08.730933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:13.360268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:13.361891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:13.369115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=231 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:13:13.397575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:13.398070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.399259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Traceback (most recent call last):
Apr 08 13:13:13.399259 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.399259 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:13.399259 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.399259 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.399259 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:13.399259 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.399259 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.400603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.402000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:13.421529 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:13.422584 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:13.422932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.423814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:13.423814 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.423814 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:13.423814 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.423814 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.423814 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:13.423814 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.423814 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.425576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.426529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:13.438434 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:13.438952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:13.439472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:13.439799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.440608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:13.440608 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.440608 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:13.440608 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.440608 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.440608 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:13.440608 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.440608 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:13.441965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.443730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:13.445046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.445990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:13.638222 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:13.638508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:13.639288 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:13.640288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.641103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:13.641103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.641103 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:13.641103 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.641103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.641103 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:13.641103 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.641103 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:13.642345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:13.643418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:13.643418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.643418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:13.643418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.643418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.643418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:13.643418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.643418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:13.644392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.645413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:13.646904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.646904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:13.726427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:13.727079 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:13.727635 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:13.728021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:13.728193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.728976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:13.728976 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.728976 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:13.728976 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.728976 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.728976 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:13.728976 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.728976 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.730862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:13.731648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:18.361016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:18.363042 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:18.399584 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:18.400558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.400850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:13:18.400850 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.400850 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:18.400850 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.400850 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.400850 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:18.400850 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.400850 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.402202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.402859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:18.422291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:18.423382 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:18.424101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.424438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:18.424438 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.424438 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:18.424438 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.424438 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.424438 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:18.424438 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.424438 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.426608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.427548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:18.438893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:18.439290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:18.440172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:18.440381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.440952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:18.440952 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.440952 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:18.440952 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.440952 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.440952 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:18.440952 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.440952 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:18.442226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:18.442756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:18.442756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.442756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:18.442756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.442756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.442756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:18.442756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.442756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:18.443800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.444538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.445343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:18.445343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.445343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:18.638844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:18.639281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:18.640024 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:18.640320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.640944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:18.640944 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.640944 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:18.640944 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.640944 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.640944 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:18.640944 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.640944 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:18.642060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:18.642919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:18.642919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.642919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:18.642919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.642919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.642919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:18.642919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.642919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:18.643300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.644215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:18.645265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.645265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:18.727040 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:18.727950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:18.728541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:18.728994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:18.729254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.730720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:18.730720 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.730720 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:18.730720 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.730720 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.730720 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:18.730720 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.730720 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.731348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:18.732153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:23.361642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:23.362678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:23.414991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.472546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:23.473430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:23.474376 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.475246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.476044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.476807 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:23.477415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.478147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:23.479142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.479971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:23.639675 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:23.640289 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:23.641036 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:23.641447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.642238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:23.642238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.642238 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:23.642238 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.642238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.642238 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:23.642238 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.642238 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:23.642830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.643927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:23.644991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.646224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:23.727816 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:23.728228 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:23.728807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:23.729057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:23.729161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.729799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:23.729799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.729799 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:23.729799 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.729799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.729799 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:23.729799 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.729799 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.731432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:23.732264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:28.362165 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:28.363071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:28.394969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:28.395448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.396313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:13:28.396313 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.396313 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:28.396313 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.396313 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.396313 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:28.396313 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.396313 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.397198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.398061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:28.423318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:28.424351 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:28.424874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.425660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:28.425660 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.425660 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:28.425660 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.425660 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.425660 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:28.425660 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.425660 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.427273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.427827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:28.439832 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:28.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:28.440846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:28.441226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.441988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:28.441988 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.441988 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:28.441988 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.441988 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.441988 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:28.441988 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.441988 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:28.443505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:28.444330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:28.444330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.444330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:28.444330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.444330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.444330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:28.444330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.444330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:28.445786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.446496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.447326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:28.447326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.447326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:28.640269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:28.640736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:28.641646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:28.642144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:28.645647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.646493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:28.647305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.648060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:28.648991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.648991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:28.728523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:28.729136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:28.729723 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:28.730193 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:28.730492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.731477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:28.731477 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.731477 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:28.731477 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.731477 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.731477 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:28.731477 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.731477 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.733141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:28.733933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:33.362687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:33.364180 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:33.396777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:33.397207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.398111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:13:33.398111 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.398111 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:33.398111 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.398111 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.398111 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:33.398111 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.398111 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.399704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.400877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:33.423881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:33.424591 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:33.424827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.425400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:33.425400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.425400 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:33.425400 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.425400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.425400 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:33.425400 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.425400 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.426635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.427470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:33.440345 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:33.440758 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:33.441253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:33.441507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.442305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:33.442305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.442305 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:33.442305 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.442305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.442305 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:33.442305 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.442305 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:33.443920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:33.444670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:33.444670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.444670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:33.444670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.444670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.444670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:33.444670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.444670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:33.445082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.445763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.446495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:33.446495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.446495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:33.641120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:33.641775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:33.642354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:33.642634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.643638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:33.643638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.643638 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:33.643638 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.643638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.643638 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:33.643638 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.643638 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:33.645059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:33.645876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:33.645876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.645876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:33.645876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.645876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.645876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:33.645876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.645876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:33.646958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.647767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:33.648744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.648744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:33.729101 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:33.729548 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:33.730083 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:33.730411 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:33.730592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.731394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:33.731394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.731394 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:33.731394 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.731394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.731394 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:33.731394 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.731394 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.733377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:33.734264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:38.363350 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:38.364778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:38.398803 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:38.399143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.400179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:13:38.400179 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.400179 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:38.400179 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.400179 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.400179 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:38.400179 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.400179 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.402232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.403043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:38.424237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:38.424670 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:38.424836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.425290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:38.425290 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.425290 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:38.425290 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.425290 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.425290 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:38.425290 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.425290 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.426079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.426847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:38.440561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:38.441070 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:38.441561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:38.441848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.442563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:38.442563 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.442563 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:38.442563 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.442563 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.442563 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:38.442563 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.442563 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:38.443996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:38.444820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:38.444820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.444820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:38.444820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.444820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.444820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:38.444820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.444820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:38.445913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.446598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.447400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:38.447400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.447400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:38.641733 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:38.642155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:38.642736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:38.643363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.643764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:38.643764 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.643764 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:38.643764 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.643764 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.643764 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:38.643764 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.643764 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:38.645047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:38.645879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:38.645879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.645879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:38.645879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.645879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.645879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:38.645879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.645879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:38.646824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.647644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:38.648583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.648583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:38.729769 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:38.730334 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:38.730928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:38.731370 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:38.731607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.732757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:38.732757 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.732757 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:38.732757 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.732757 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.732757 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:38.732757 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.732757 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.734546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:38.735443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:43.363982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:43.365753 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:43.395670 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:43.395873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.396518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:13:43.396518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.396518 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:43.396518 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.396518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.396518 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:43.396518 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.396518 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.397541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.398359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:43.424655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:43.425588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:43.425949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.426766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:43.426766 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.426766 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:43.426766 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.426766 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.426766 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:43.426766 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.426766 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.427919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.428677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:43.441074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:43.441454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:43.441961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:43.442823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.443482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:43.443482 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.443482 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:43.443482 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.443482 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.443482 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:43.443482 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.443482 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:43.444739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:43.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:43.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:43.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:43.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:43.446327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.447134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:43.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:43.642471 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:43.642926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:43.643800 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:43.644186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.645214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:43.645214 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.645214 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:43.645214 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.645214 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.645214 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:43.645214 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.645214 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:43.646745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:43.647207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:43.647207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.647207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:43.647207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.647207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.647207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:43.647207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.647207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:43.648606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.649158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:43.649761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.649761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:43.730601 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:43.731763 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:43.732327 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:43.732626 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:43.732796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.733451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:43.733451 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.733451 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:43.733451 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.733451 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.733451 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:43.733451 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.733451 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.735457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:43.736418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:48.364671 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:48.366323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:48.393556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:48.393869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.394790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:13:48.394790 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.394790 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:48.394790 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.394790 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.394790 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:48.394790 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.394790 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.395666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.396419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:48.425171 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:48.426227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:48.426555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.427363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:48.427363 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.427363 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:48.427363 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.427363 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.427363 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:48.427363 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.427363 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.428589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.429240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:48.441596 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:48.442561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:48.443219 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:48.443532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.444395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:48.444395 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.444395 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:48.444395 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.444395 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.444395 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:48.444395 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.444395 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:48.445672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:48.446574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:48.446574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.446574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:48.446574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.446574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.446574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:48.446574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.446574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:48.447107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.447836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.448649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:48.448649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.448649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:48.643144 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:48.643938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:48.644542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:48.644968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.645749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:48.645749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.645749 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:48.645749 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.645749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.645749 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:48.645749 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.645749 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:48.649245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.650066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:48.650770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.651291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:48.732024 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:48.732496 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:48.733225 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:48.733983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:48.733983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.734738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:48.734738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.734738 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:48.734738 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.734738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.734738 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:48.734738 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.734738 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.736756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:48.739137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:53.365354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:53.368506 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:53.404034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:53.404447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.405489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:13:53.405489 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.405489 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:53.405489 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.405489 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.405489 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:53.405489 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.405489 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.407049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.407553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:53.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:53.426587 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:53.426891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.427598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:53.427598 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.427598 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:53.427598 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.427598 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.427598 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:53.427598 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.427598 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.429593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.430088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:53.445971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:53.446348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:53.446830 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:53.447104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.447901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:53.447901 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.447901 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:53.447901 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.447901 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.447901 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:53.447901 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.447901 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:53.449102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:53.450093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:53.450093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.450093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:53.450093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.450093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.450093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:53.450093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.450093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:53.450549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.452151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:53.452151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.452151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:53.644021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:53.644290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:53.644849 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:53.645152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.645789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:53.645789 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.645789 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:53.645789 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.645789 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.645789 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:53.645789 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.645789 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:53.647011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:53.647967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:53.647967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.647967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:53.647967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.647967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.647967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:53.647967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.647967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:53.648508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.649733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:53.650558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.650558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:53.732632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:53.733084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:53.733634 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:53.734093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:53.734328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.735310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:53.735310 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.735310 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:53.735310 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.735310 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.735310 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:53.735310 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.735310 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.736577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:53.737314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:58.366228 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:58.367919 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:58.401346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:58.401824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.402752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:13:58.402752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.402752 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:58.402752 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.402752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.402752 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:58.402752 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.402752 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.403789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.404472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:58.426183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:58.427058 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:58.427383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.428399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:58.428399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.428399 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:58.428399 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.428399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.428399 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:58.428399 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.428399 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.430372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.431183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:58.446421 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:58.446956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:13:58.447710 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:58.448014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.448841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:58.448841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.448841 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:58.448841 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.448841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.448841 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:58.448841 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.448841 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:58.450111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:58.450509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:58.450509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.450509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:58.450509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.450509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.450509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:58.450509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.450509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:13:58.451606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.452032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.452453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:58.452453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.452453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:58.645111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:58.645111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:58.645511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:58.645694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.646246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:58.646246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.646246 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:58.646246 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.646246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.646246 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:58.646246 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.646246 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:13:58.646981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:58.647372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:13:58.647372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.647372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:13:58.647372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.647372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.647372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:13:58.647372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.647372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:13:58.647992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.648377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:58.648848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.648848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:13:58.733302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:13:58.733679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:13:58.734235 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:58.734603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:13:58.734860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.735584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:13:58.735584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.735584 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:13:58.735584 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.735584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.735584 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:13:58.735584 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.735584 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.737338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:13:58.738042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:03.366806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:03.368511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:03.395815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:03.396176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.397665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:14:03.397665 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.397665 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:03.397665 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.397665 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.397665 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:03.397665 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.397665 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.398578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.399810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:03.426723 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:03.427541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:03.427838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.428516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:03.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:03.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:03.428516 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.428516 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.430079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.431138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:03.447008 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:03.447371 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:03.447893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:03.448157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.448840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:03.448840 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.448840 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:03.448840 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.448840 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.448840 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:03.448840 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.448840 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:03.450226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:03.451283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:03.451283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.451283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:03.451283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.451283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.451283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:03.451283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.451283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:03.451859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.452902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.453857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:03.453857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.453857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:03.645194 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:03.645546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:03.646136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:03.646764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.646993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:03.646993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.646993 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:03.646993 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.646993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.646993 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:03.646993 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.646993 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:03.647874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:03.648413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:03.648413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.648413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:03.648413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.648413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.648413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:03.648413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.648413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:03.648900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.649461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:03.650104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.650104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:03.733909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:03.734366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:03.735317 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:03.735871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:03.736063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.737054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:03.737054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.737054 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:03.737054 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.737054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.737054 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:03.737054 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.737054 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.738955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:03.739750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:08.367495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:08.369261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:08.403505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:08.403772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.404547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:14:08.404547 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.404547 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:08.404547 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.404547 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.404547 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:08.404547 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.404547 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.405448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.405993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:08.427299 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:08.428491 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:08.428933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.429801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:08.429801 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.429801 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:08.429801 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.429801 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.429801 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:08.429801 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.429801 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.431898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.432755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:08.447307 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:08.447634 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:08.448310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:08.448753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.449597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:08.449597 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.449597 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:08.449597 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.449597 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.449597 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:08.449597 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.449597 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:08.450904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:08.451661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:08.451661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.451661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:08.451661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.451661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.451661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:08.451661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.451661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:08.452548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.453283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.454186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:08.454186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.454186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:08.646199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:08.647030 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:08.647638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:08.648074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.649036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:08.649036 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.649036 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:08.649036 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.649036 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.649036 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:08.649036 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.649036 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:08.650746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:08.651554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:08.651554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.651554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:08.651554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.651554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.651554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:08.651554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.651554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:08.652125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.652817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:08.653564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.653564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:08.734664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:08.735395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:08.736046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:08.736578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:08.736810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.737738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:08.737738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.737738 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:08.737738 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.737738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.737738 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:08.737738 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.737738 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.739302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:08.740135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:13.368185 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:13.369938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:13.378672 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:14:13.407794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:13.408214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.409172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:14:13.409172 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.409172 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:13.409172 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.409172 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.409172 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:13.409172 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.409172 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.410298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.411075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:13.427904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:13.433361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:13.433695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.434655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:13.434655 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.434655 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:13.434655 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.434655 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.434655 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:13.434655 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.434655 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.436461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.437188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:13.447954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:13.448377 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:13.448927 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:13.449219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.450044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:13.450044 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.450044 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:13.450044 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.450044 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.450044 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:13.450044 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.450044 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:13.451060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.452386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:13.453092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.453915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:13.646977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:13.647504 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.649249 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:13.650264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:13.651206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:13.651206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.651206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:13.651206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.651206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.651206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:13.651206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.651206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:13.652796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.653245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:13.653801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.653801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:13.735411 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:13.735788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:13.736262 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:13.736740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:13.736869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.737718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:13.737718 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.737718 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:13.737718 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.737718 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.737718 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:13.737718 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.737718 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.738680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:13.739417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:18.368873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:18.370637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:18.403058 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:18.403295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.403971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Traceback (most recent call last):
Apr 08 13:14:18.403971 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.403971 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:18.403971 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.403971 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.403971 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:18.403971 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.403971 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.405234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.406132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:18.433125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:18.434108 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:18.434394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.435320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Traceback (most recent call last):
Apr 08 13:14:18.435320 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.435320 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:18.435320 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.435320 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.435320 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:18.435320 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.435320 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:18.437764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.438505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:18.448483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:18.448738 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:18.450285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:18.450285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.450485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:18.450485 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.450485 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:18.450485 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.450485 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.450485 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:18.450485 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.450485 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:18.452173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:18.453037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:18.453037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.453037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:18.453037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.453037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.453037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:18.453037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.453037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:18.453543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.454309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:18.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:18.647679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:18.648107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:18.648762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:18.649168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.650028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:18.650028 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.650028 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:18.650028 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.650028 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.650028 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:18.650028 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.650028 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:18.651281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:18.651988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:18.651988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.651988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:18.651988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.651988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.651988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:18.651988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.651988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:18.652848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.653609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:18.654406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.654406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:18.735937 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:18.736353 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:18.736940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:18.737401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:18.737679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.738517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:18.738517 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.738517 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:18.738517 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.738517 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.738517 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:18.738517 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.738517 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.740065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:18.740815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:23.369417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:23.371071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:23.403861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:23.404777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.405120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Traceback (most recent call last):
Apr 08 13:14:23.405120 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.405120 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:23.405120 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.405120 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.405120 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:23.405120 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.405120 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.406860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.407383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:23.433666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:23.434950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:23.435445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.436446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:23.436446 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.436446 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:23.436446 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.436446 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.436446 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:23.436446 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.436446 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.438824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.439874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:23.449001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:23.449374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:23.450244 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:23.450789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.451883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:23.451883 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.451883 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:23.451883 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.451883 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.451883 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:23.451883 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.451883 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:23.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:23.453780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:23.453780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.453780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:23.453780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.453780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.453780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:23.453780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.453780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:23.456401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.457147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.457994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:23.457994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.457994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:23.648462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:23.648865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:23.649511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:23.649874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.650489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:23.650489 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.650489 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:23.650489 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.650489 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.650489 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:23.650489 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.650489 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:23.651336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:23.652247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:23.652247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.652247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:23.652247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.652247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.652247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:23.652247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.652247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:23.652643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.653426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:23.654319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.654319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:23.736459 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:23.736977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:23.737462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:23.737884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:23.738069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.738815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:23.738815 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.738815 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:23.738815 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.738815 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.738815 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:23.738815 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.738815 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.740309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:23.741254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:28.370104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:28.371853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:28.406089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:28.406490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.407353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Traceback (most recent call last):
Apr 08 13:14:28.407353 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.407353 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:28.407353 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.407353 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.407353 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:28.407353 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.407353 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.408505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.409369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:28.434441 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:28.435452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:28.435780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.436553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:28.436553 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.436553 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:28.436553 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.436553 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.436553 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:28.436553 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.436553 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.438305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.439074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:28.449344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:28.449852 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:28.450369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:28.450726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.451526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:28.451526 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.451526 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:28.451526 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.451526 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.451526 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:28.451526 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.451526 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:28.452840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:28.453567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:28.453567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.453567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:28.453567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.453567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.453567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:28.453567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.453567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:28.454318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.456084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:28.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:28.649090 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:28.649402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:28.649933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:28.650306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.651081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:28.651081 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.651081 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:28.651081 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.651081 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.651081 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:28.651081 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.651081 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:28.652216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:28.652929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:28.652929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.652929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:28.652929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.652929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.652929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:28.652929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.652929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:28.653958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.654647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:28.655108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.655108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:28.737131 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:28.737647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:28.738204 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:28.738573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:28.738855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.739784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:28.739784 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.739784 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:28.739784 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.739784 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.739784 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:28.739784 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.739784 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.741342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:28.742199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:33.370866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:33.373064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:33.417397 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:33.417835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.418745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Traceback (most recent call last):
Apr 08 13:14:33.418745 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.418745 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:33.418745 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.418745 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.418745 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:33.418745 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.418745 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.419996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.420828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:33.435112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:33.436248 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:33.436555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.437306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:33.437306 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.437306 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:33.437306 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.437306 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.437306 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:33.437306 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.437306 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.439154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:33.449953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:33.450268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:33.450903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:33.451216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.452005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:33.452005 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.452005 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:33.452005 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.452005 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.452005 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:33.452005 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.452005 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:33.453377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:33.454099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:33.454099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.454099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:33.454099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.454099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.454099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:33.454099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.454099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:33.455585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.456334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.457140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:33.457140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.457140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:33.649669 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:33.650026 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:33.650468 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:33.650739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.651267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:33.651267 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.651267 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:33.651267 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.651267 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.651267 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:33.651267 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.651267 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:33.652138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:33.652804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:33.652804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.652804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:33.652804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.652804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.652804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:33.652804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.652804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:33.653126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.653754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:33.654465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.654465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:33.737797 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:33.738299 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:33.738729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:33.739041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:33.739293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.739972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:33.739972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.739972 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:33.739972 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.739972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.739972 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:33.739972 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.739972 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.741472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:33.742220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:38.371521 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:38.372893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:38.407480 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:38.407859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.408557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:14:38.408557 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.408557 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:38.408557 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.408557 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.408557 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:38.408557 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.408557 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.409310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.410081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:38.435632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:38.436554 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:38.436819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.437471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:38.437471 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.437471 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:38.437471 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.437471 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.437471 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:38.437471 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.437471 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.439220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.439966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:38.450222 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:38.450906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:38.451201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:38.451398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:38.454650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.455499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:38.456172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.456886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.457724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:38.457724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.457724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:38.650233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:38.650585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:38.651395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:38.651971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.652851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:38.652851 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.652851 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:38.652851 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.652851 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.652851 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:38.652851 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.652851 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:38.654080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:38.654870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:38.654870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.654870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:38.654870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.654870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.654870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:38.654870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.654870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:38.655635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.656407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:38.657287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.657287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:38.738403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:38.739176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:38.739852 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:38.740442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:38.740744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.741924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:38.741924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.741924 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:38.741924 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.741924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.741924 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:38.741924 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.741924 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.743073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:38.743892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:43.372030 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:43.372982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:43.408838 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:43.409112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.409776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:14:43.409776 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.409776 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:43.409776 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.409776 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.409776 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:43.409776 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.409776 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.410700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:43.437952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:43.438897 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:43.439216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.439833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:43.439833 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.439833 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:43.439833 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.439833 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.439833 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:43.439833 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.439833 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.440897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.441399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:43.450559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:43.450988 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:43.451388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:43.451603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.452152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:43.452152 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.452152 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:43.452152 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.452152 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.452152 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:43.452152 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.452152 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:43.453417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:43.453846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:43.453846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.453846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:43.453846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.453846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.453846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:43.453846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.453846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:43.455061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.455460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.455933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:43.455933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.455933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:43.650974 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:43.651992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:43.653054 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:43.653307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.654267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:43.654267 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.654267 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:43.654267 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.654267 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.654267 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:43.654267 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.654267 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:43.656673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.657320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:43.658176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.658934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:43.738999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:43.739636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:43.740096 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:43.740537 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:43.740836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.741440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:43.741440 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.741440 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:43.741440 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.741440 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.741440 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:43.741440 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.741440 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.742930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:43.743356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:48.372648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:48.374526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:48.407721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:48.407993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.408811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:14:48.408811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.408811 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:48.408811 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.408811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.408811 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:48.408811 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.408811 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.409704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.410059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:48.439812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:48.440164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:48.440401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.441077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:48.441077 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.441077 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:48.441077 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.441077 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.441077 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:48.441077 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.441077 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.442937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.443727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:48.453653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:48.453653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:48.453653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:48.453653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.454114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:48.454114 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.454114 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:48.454114 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.454114 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.454114 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:48.454114 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.454114 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:48.454752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.455598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:48.456445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.457446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:48.651585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:48.651952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:48.652487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:48.652747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.653222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:48.653222 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.653222 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:48.653222 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.653222 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.653222 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:48.653222 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.653222 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:48.654055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.655445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:48.656136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.657009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:48.739513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:48.740157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:48.740870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:48.741280 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:48.741477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.742283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:48.742283 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.742283 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:48.742283 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.742283 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.742283 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:48.742283 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.742283 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.744418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:48.745276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:51.677905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=9fdae9fb-7507-4b91-ba4b-7cea3b9f2a61, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-71709845-924e-42fd-985e-d000e2c61286', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5 88cc7e33-1b68-4e35-9edc-36247de507c0'}, gateway_chassis=[9e3bed82-cd8e-45cb-a970-24734b79c6bc], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d4:5c:4e', name='lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0', networks=['172.24.5.223/24', '2001:db8::19/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=104932) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 08 13:14:53.373893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:53.375512 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:53.409732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.410039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.410676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:14:53.410676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.410676 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:53.410676 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.410676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.410676 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:53.410676 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.410676 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.411871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.412733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:53.439711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:53.440740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.441000 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.441230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.441912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:53.441912 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.441912 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:53.441912 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.441912 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.441912 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:53.441912 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.441912 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.442701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.443057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:53.452921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:53.453393 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:53.453876 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.454098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.455871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:53.455871 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.455871 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:53.455871 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.455871 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.455871 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:53.455871 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.455871 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:53.457282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:53.458202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:53.458202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.458202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:53.458202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.458202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.458202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:53.458202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.458202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:53.459487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.460304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.461202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:53.461202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.461202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:53.652312 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:53.652912 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:53.653579 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.653894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.654451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:53.654451 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.654451 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:53.654451 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.654451 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.654451 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:53.654451 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.654451 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:53.655229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:53.655685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:53.655685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.655685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:53.655685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.655685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.655685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:53.655685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.655685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:53.656236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.656712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:53.657209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.657209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:53.741929 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:53.743806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:53.748404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5a00235f-90e4-4dbc-9102-d21d723b5347, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-daec8bf3-7182-4be9-bfe4-655236471090', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-71709845-924e-42fd-985e-d000e2c61286', 'neutron:subnet_ids': '28da0a33-78ce-48f8-89df-3533da3ec3de'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:40:35:3f', name='lrp-2fbfe598-33e1-4e9c-a9e2-46a6ecb027fd', networks=['192.168.24.1/24'], options={}, peer=[], status={}) old= {{(pid=104932) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 08 13:14:53.752629 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.752808 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.752916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.755092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:53.755092 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.755092 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:53.755092 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.755092 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.755092 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:53.755092 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.755092 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.758749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.759470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:53.779463 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-daec8bf3-7182-4be9-bfe4-655236471090 synchronized; highest priority chassis f9890283-994e-44b6-8937-b9b9f047f9cb
Apr 08 13:14:53.779564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-daec8bf3-7182-4be9-bfe4-655236471090, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'daec8bf3-7182-4be9-bfe4-655236471090', 'neutron:router_id': '71709845-924e-42fd-985e-d000e2c61286'}}) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.779928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-daec8bf3-7182-4be9-bfe4-655236471090, chassis=f9890283-994e-44b6-8937-b9b9f047f9cb, priority=1, columns={}) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:53.780185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.780759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:53.780759 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.780759 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:53.780759 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.780759 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.780759 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:53.780759 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.780759 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 86, in run
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     next(self.gen)
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     next(self.gen)
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 08 13:14:53.781787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     raise result.ex
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:53.782970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.event 
Apr 08 13:14:58.374453 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:58.376772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:58.408093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:58.408449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.409385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:14:58.409385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.409385 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:58.409385 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.409385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.409385 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:58.409385 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.409385 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.410524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.411271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:58.440855 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:58.441879 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:58.442155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:58.442366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.443084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:58.443084 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.443084 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:58.443084 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.443084 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.443084 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:58.443084 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.443084 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.444825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.445296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:58.453285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:58.453606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:14:58.454027 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:58.454274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.455078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:58.455078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.455078 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:58.455078 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.455078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.455078 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:58.455078 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.455078 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:58.456211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:58.456526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:58.456526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.456526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:58.456526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.456526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.456526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:58.456526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.456526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:14:58.457775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.458073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.458404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:58.458404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.458404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:58.653095 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:58.653631 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:58.654367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:58.654918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.655754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:58.655754 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.655754 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:58.655754 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.655754 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.655754 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:58.655754 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.655754 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:14:58.657061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:58.657863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:14:58.657863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.657863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:14:58.657863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.657863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.657863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:14:58.657863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.657863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:14:58.658457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.659242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:58.660142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.660142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:14:58.743701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:14:58.744197 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:14:58.744720 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:58.745017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:14:58.745223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.745785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:14:58.745785 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.745785 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:14:58.745785 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.745785 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.745785 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:14:58.745785 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.745785 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.746593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:14:58.746981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:03.375809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:03.376680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:03.405573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:03.406086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.407126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:15:03.407126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.407126 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:03.407126 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.407126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.407126 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:03.407126 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.407126 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.408054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.408567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:03.441355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:03.442401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:03.442788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:03.443034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.443879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:03.443879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.443879 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:03.443879 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.443879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.443879 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:03.443879 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.443879 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.446087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:03.453742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:03.454248 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:03.454853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:03.455119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.455825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:03.455825 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.455825 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:03.455825 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.455825 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.455825 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:03.455825 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.455825 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:03.457142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:03.457607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:03.457607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.457607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:03.457607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.457607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.457607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:03.457607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.457607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:03.458722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.459256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.459887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:03.459887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.459887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:03.653695 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:03.653952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:03.654885 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:03.654885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.655122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:03.655122 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.655122 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:03.655122 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.655122 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.655122 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:03.655122 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.655122 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:03.655875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:03.656527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:03.656527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.656527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:03.656527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.656527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.656527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:03.656527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.656527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:03.657040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.657775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:03.658932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.658932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:03.744400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:03.745010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:03.745546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:03.746050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:03.746309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.747134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:03.747134 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.747134 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:03.747134 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.747134 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.747134 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:03.747134 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.747134 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.748785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:03.749942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:08.376237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:08.377199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:08.415256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:08.415893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.416520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:15:08.416520 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.416520 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:08.416520 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.416520 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.416520 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:08.416520 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.416520 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.418408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.420383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:08.441955 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:08.442838 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:08.443066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:08.443688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.444050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:08.444050 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.444050 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:08.444050 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.444050 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.444050 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:08.444050 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.444050 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.445008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:08.454174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:08.454589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:08.455140 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:08.456067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.456243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:08.456243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.456243 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:08.456243 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.456243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.456243 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:08.456243 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.456243 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:08.457039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:08.457985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:08.457985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.457985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:08.457985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.457985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.457985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:08.457985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.457985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:08.458555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.460464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:08.460464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.460464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:08.654326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:08.655120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:08.655740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:08.656238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.657069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:08.657069 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.657069 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:08.657069 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.657069 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.657069 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:08.657069 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.657069 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:08.658189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:08.658968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:08.658968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.658968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:08.658968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.658968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.658968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:08.658968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.658968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:08.659763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.660484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:08.661313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.661313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:08.744917 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:08.745497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:08.746098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:08.746522 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:08.746776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.747575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:08.747575 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.747575 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:08.747575 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.747575 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.747575 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:08.747575 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.747575 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.749241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:08.750028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:13.376932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:13.378521 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:13.389195 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=258 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:15:13.415420 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:13.415946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.417021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:15:13.417021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.417021 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:13.417021 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.417021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.417021 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:13.417021 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.417021 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.418221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.418983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:13.442606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:13.443743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:13.444078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:13.444344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.445118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:13.445118 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.445118 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:13.445118 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.445118 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.445118 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:13.445118 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.445118 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.446905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.447695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:13.454742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:13.455162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:13.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:13.456113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.457000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:13.457000 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.457000 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:13.457000 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.457000 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.457000 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:13.457000 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.457000 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:13.458300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:13.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:13.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:13.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:13.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:13.459882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.460595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.461477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:13.461477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.461477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:13.655365 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:13.655645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:13.656243 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:13.656535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.657119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:13.657119 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.657119 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:13.657119 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.657119 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.657119 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:13.657119 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.657119 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:13.657760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:13.658227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:13.658227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.658227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:13.658227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.658227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.658227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:13.658227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.658227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:13.658532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.659170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:13.659875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.659875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:13.745594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:13.746072 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:13.746755 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:13.747070 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:13.747248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.747992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:13.747992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.747992 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:13.747992 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.747992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.747992 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:13.747992 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.747992 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.750056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:13.750803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:18.377516 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:18.379046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:18.414281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:18.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.415257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:15:18.415257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.415257 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:18.415257 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.415257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.415257 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:18.415257 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.415257 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.416546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.417225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:18.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:18.445210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:18.445521 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:18.445985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.446926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:18.446926 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.446926 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:18.446926 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.446926 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.446926 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:18.446926 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.446926 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.448400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.448988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:18.455142 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:18.455969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:18.456558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:18.456888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.457924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:18.457924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.457924 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:18.457924 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.457924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.457924 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:18.457924 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.457924 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:18.459412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:18.459896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:18.459896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.459896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:18.459896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.459896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.459896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:18.459896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.459896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:18.461102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.461576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.462208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:18.462208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.462208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:18.656060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:18.656443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:18.657233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:18.657833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.658677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:18.658677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.658677 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:18.658677 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.658677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.658677 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:18.658677 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.658677 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:18.660006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:18.660809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:18.660809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.660809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:18.660809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.660809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.660809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:18.660809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.660809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:18.661853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.662561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:18.663422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.663422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:18.746267 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:18.746636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:18.747273 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:18.747700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:18.747947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.748741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:18.748741 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.748741 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:18.748741 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.748741 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.748741 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:18.748741 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.748741 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.750362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:18.751140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:23.316052 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:23.325508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 08 13:15:23.325778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Number of inconsistencies found at create/update: networks=3, security_groups=1 {{(pid=104932) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 08 13:15:23.325879 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:15:23.357373 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, resource={'id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'name': 'private', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['b9c480ba-80ab-475b-b935-84420037c6ca', 'd4905e6d-9f85-4996-afec-3692c12d93d1'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:10:08Z', 'updated_at': '2026-04-08T13:10:12Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21658}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.357872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.358385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c9a391e0-7fa7-4719-b96c-81fc2e60a06f, external_ids_update=None, columns={'tag': 21658}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.358592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.359520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:15:23.359520 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.359520 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:23.359520 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.359520 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.359520 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:23.359520 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.359520 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:15:23.360748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.361343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.362113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:15:23.362113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.362113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:15:23.362113 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:15:23.377971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:23.381854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:23.423011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, resource={'id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'name': 'public', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['88cc7e33-1b68-4e35-9edc-36247de507c0', 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-08T13:10:14Z', 'updated_at': '2026-04-08T13:10:22Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.425135 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.426975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-83258353-9720-4502-8be2-b82538bb4ee2, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.427413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.429463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:15:23.429463 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.429463 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:23.429463 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.429463 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.429463 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:23.429463 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.429463 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:15:23.432084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.432670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.433337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:15:23.433337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.433337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:15:23.433337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:15:23.446028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:23.449313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.451076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.452041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.452871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:23.452871 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.452871 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:23.452871 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.452871 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.452871 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:23.452871 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.452871 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.458795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.459693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:23.460663 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:23.462718 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:23.463569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.463970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.465886 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.466129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.466966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Traceback (most recent call last):
Apr 08 13:15:23.466966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.466966 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:23.466966 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.466966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.466966 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:23.466966 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.466966 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:23.468843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:23.468843 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.468843 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:23.468843 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.468843 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.468843 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:23.468843 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.468843 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.472516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.473071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:23.477160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.478112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:23.478112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.478112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:23.478112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.478112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.478112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:23.478112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.478112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:23.478994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.479754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.480548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:23.480548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.480548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:23.498827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, resource={'id': 'a5d505fb-12e2-4aed-8078-02b88b929c5e', 'name': 'admin_net', 'tenant_id': '98be377457d344c7834b290dc92d0dda', 'project_id': '98be377457d344c7834b290dc92d0dda', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['39438f35-bd24-4a86-8cab-99f980e8887d'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:05Z', 'updated_at': '2026-04-08T13:14:07Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 13489}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.499161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.499499 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-daf5372b-8660-44b8-b300-e46a7451059b, external_ids_update=None, columns={'tag': 13489}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.499658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.500479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:15:23.500479 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.500479 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:23.500479 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.500479 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.500479 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:23.500479 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.500479 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:15:23.501717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.502285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.502944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:15:23.502944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.502944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:15:23.502944 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource 0a8ba667-400c-478f-a125-e9a264f873f9 (type: security_groups) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:15:23.656891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:23.657502 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:23.658766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.659640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.660507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:23.660507 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.660507 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:23.660507 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.660507 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.660507 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:23.660507 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.660507 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:23.662090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.662870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:23.662870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.662870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:23.662870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.662870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.662870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:23.662870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.662870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:23.663870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.664783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:23.665900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.665900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:23.746823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:23.747156 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:23.747774 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.748221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:23.748459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.749236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:23.749236 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.749236 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:23.749236 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.749236 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.749236 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:23.749236 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.749236 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.750472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:23.751275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:27.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.db.ovn_revision_numbers_db [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Successfully bumped revision number for resource 0a8ba667-400c-478f-a125-e9a264f873f9 (type: security_groups) to 9
Apr 08 13:15:27.284274 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Synchronization completed (took 3.96 seconds)
Apr 08 13:15:28.379841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:28.381706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:28.418738 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:28.418979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.419556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:15:28.419556 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.419556 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:28.419556 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.419556 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.419556 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:28.419556 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.419556 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.420419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.421211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:28.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:28.448069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:28.448377 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:28.448603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.449588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:15:28.449588 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.449588 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:28.449588 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.449588 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.449588 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:28.449588 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.449588 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:28.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.452468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:28.462852 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:28.463356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:28.463924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:28.464209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.465105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:28.465105 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.465105 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:28.465105 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.465105 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.465105 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:28.465105 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.465105 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:28.466422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:28.467218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:28.467218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.467218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:28.467218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.467218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.467218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:28.467218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.467218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:28.468017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.468780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.469745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:28.469745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.469745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:28.657881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:28.658461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:28.659155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:28.659537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.660423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:28.660423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.660423 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:28.660423 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.660423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.660423 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:28.660423 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.660423 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:28.661816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:28.662483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:28.662483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.662483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:28.662483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.662483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.662483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:28.662483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.662483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:28.663511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.664255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:28.665096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.665096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:28.747661 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:28.748214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:28.748930 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:28.749308 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:28.749538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.750280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:28.750280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.750280 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:28.750280 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.750280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.750280 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:28.750280 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.750280 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.752113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:28.752657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:33.380732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:33.382230 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:33.416766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:33.417179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.418208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:15:33.418208 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.418208 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:33.418208 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.418208 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.418208 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:33.418208 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.418208 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.419188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.420040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:33.447498 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:33.448564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:33.448949 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:33.449180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.450090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:15:33.450090 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.450090 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:33.450090 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.450090 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.450090 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:33.450090 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.450090 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:33.451839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.452642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:33.463319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:33.463906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:33.464485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:33.464915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.465867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:15:33.465867 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.465867 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:33.465867 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.465867 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.465867 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:33.465867 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.465867 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:33.467591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.468561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:33.469644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.470135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.470786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:33.470786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.470786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:33.658385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:33.658856 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:33.659641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:33.660160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.661076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:33.661076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.661076 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:33.661076 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.661076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.661076 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:33.661076 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.661076 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:33.662506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:33.663337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:33.663337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.663337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:33.663337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.663337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.663337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:33.663337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.663337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:33.664216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.665032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:33.665990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.665990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:33.748638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:33.749881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:33.750409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:33.750978 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:33.751069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.751910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:33.751910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.751910 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:33.751910 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.751910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.751910 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:33.751910 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.751910 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.753434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:33.754310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:38.381428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:38.382702 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:38.421701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:38.421829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.422644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:15:38.422644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.422644 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:38.422644 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.422644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.422644 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:38.422644 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.422644 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.424961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.426428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:38.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:38.449380 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:38.449566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:38.449847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.450863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:15:38.450863 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.450863 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:38.450863 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.450863 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.450863 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:38.450863 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.450863 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:38.452647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.453534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:38.463812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:38.464302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:38.464705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:38.465032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.466097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:38.466097 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.466097 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:38.466097 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.466097 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.466097 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:38.466097 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.466097 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:38.466589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:38.467395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:38.467395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.467395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:38.467395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.467395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.467395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:38.467395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.467395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:38.467789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.468473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.469333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:38.469333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.469333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:38.659113 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:38.659493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:38.660054 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:38.660274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.660758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:38.660758 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.660758 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:38.660758 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.660758 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.660758 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:38.660758 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.660758 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:38.661720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:38.662364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:38.662364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.662364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:38.662364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.662364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.662364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:38.662364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.662364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:38.663118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.663709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:38.664260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.664260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:38.749424 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:38.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:38.750773 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:38.751291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:38.751587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.752513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:38.752513 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.752513 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:38.752513 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.752513 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.752513 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:38.752513 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.752513 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.754203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:38.754995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:43.382586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:43.384292 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:43.425008 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:43.425459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.426580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:15:43.426580 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.426580 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:43.426580 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.426580 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.426580 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:43.426580 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.426580 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.429333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:43.448584 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:43.449648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:43.450116 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:43.450519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.451371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:15:43.451371 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.451371 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:43.451371 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.451371 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.451371 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:43.451371 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.451371 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:43.453081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.454028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:43.464318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:43.464932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:43.465604 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:43.465960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.466677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:43.466677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.466677 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:43.466677 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.466677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.466677 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:43.466677 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.466677 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:43.468018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:43.468741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:43.468741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.468741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:43.468741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.468741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.468741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:43.468741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.468741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:43.469540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.470995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.472867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:43.472867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.472867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:43.659611 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:43.660165 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:43.660933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:43.661316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.662088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:43.662088 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.662088 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:43.662088 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.662088 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.662088 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:43.662088 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.662088 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:43.662983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:43.663420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:43.663420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.663420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:43.663420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.663420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.663420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:43.663420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.663420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:43.664077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:43.665055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.665055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:43.750009 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:43.750527 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:43.751104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:43.751586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:43.752062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.752503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:43.752503 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.752503 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:43.752503 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.752503 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.752503 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:43.752503 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.752503 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.753807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:43.754259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:48.383392 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:48.386050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:48.424864 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:48.425278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.426260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:15:48.426260 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.426260 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:48.426260 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.426260 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.426260 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:48.426260 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.426260 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.427513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.428003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:48.449108 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:48.450426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:48.450820 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:48.451064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.451893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:48.451893 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.451893 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:48.451893 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.451893 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.451893 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:48.451893 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.451893 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.453460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.454290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:48.464829 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:48.465484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:48.465863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:48.466146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.466906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:15:48.466906 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.466906 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:48.466906 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.466906 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.466906 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:48.466906 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.466906 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:48.467826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.468674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:48.469056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.469796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.470665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:48.470665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.470665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:48.660409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:48.661421 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:48.662487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:48.663024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.664078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:48.664078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.664078 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:48.664078 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.664078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.664078 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:48.664078 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.664078 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:48.665448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:48.665987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:48.665987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.665987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:48.665987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.665987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.665987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:48.665987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.665987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:48.666571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.667239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:48.668440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.668440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:48.750968 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:48.751483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:48.752387 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:48.752867 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:48.753100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.754150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:48.754150 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.754150 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:48.754150 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.754150 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.754150 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:48.754150 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.754150 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.756230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:48.757109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:53.384256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:53.385991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:53.418423 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:53.418989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.419383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:15:53.419383 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.419383 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:53.419383 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.419383 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.419383 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:53.419383 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.419383 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.420482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.421327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:53.450019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:53.451262 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:53.451645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:53.452415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.452779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:53.452779 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.452779 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:53.452779 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.452779 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.452779 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:53.452779 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.452779 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.454779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.455788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:53.465233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:53.465781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:53.466275 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:53.466427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.467196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:15:53.467196 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.467196 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:53.467196 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.467196 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.467196 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:53.467196 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.467196 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:53.467924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.468413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:53.468883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.469350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.470011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:53.470011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.470011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:53.661367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:53.661832 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:53.662921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:53.663574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.664412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:53.664412 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.664412 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:53.664412 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.664412 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.664412 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:53.664412 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.664412 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:53.665103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.666075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:53.667238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.667867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:53.752326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:53.753022 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:53.753823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:53.754322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:53.754567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.756273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:53.756273 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.756273 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:53.756273 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.756273 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.756273 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:53.756273 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.756273 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.758158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:53.759003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:58.384992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:58.386634 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:58.423526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:58.423968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.424733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:15:58.424733 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.424733 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:58.424733 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.424733 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.424733 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:58.424733 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.424733 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.425790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.426645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:58.450417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:58.451343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:58.451652 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:58.451971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.452746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:58.452746 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.452746 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:58.452746 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.452746 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.452746 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:58.452746 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.452746 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.453963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.454872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:58.465913 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:58.466498 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:15:58.467008 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:58.467280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.468026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:15:58.468026 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.468026 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:58.468026 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.468026 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.468026 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:58.468026 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.468026 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:58.469272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.469887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:15:58.470803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.471420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.472186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:58.472186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.472186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:58.661928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:58.662350 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:58.663095 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:58.663687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:58.664534 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.664534 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:58.664534 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.664534 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.664534 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:58.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.664534 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:15:58.665238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:58.665884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:15:58.665884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.665884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:15:58.665884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.665884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.665884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:15:58.665884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.665884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:15:58.666221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.666657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:58.667286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.667286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:15:58.752937 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:15:58.753279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:15:58.754176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:58.754565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:15:58.755044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.756018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:15:58.756018 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.756018 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:15:58.756018 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.756018 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.756018 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:15:58.756018 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.756018 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.757812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:15:58.758319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:03.385469 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:03.386403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:03.422170 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:03.422576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.423493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:03.423493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.423493 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:03.423493 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.423493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.423493 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:03.423493 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.423493 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.424775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.425820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:03.450889 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:03.452041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:03.452439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:03.452756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.453571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:03.453571 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.453571 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:03.453571 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.453571 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.453571 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:03.453571 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.453571 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.455410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.456253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:03.466590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:03.466972 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:03.468362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:03.468874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.469417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:03.469417 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.469417 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:03.469417 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.469417 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.469417 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:03.469417 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.469417 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:03.470639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.471261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:03.472260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.472946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.473693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:03.473693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.473693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:03.662591 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:03.663054 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:03.663839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:03.664247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.665085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:03.665085 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.665085 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:03.665085 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.665085 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.665085 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:03.665085 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.665085 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:03.666655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:03.667746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:03.667746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.667746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:03.667746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.667746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.667746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:03.667746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.667746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:03.669188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.669842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:03.670526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.670526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:03.753467 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:03.754217 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:03.754594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:03.754954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:03.755167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.757592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:03.758444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:03.759288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:03.759288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:03.759288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:03.759288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:08.386197 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:08.387807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:08.421794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:08.422207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.423184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:08.423184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.423184 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:08.423184 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.423184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.423184 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:08.423184 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.423184 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.424254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.425040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:08.451426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:08.452355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:08.452689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:08.452923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.453588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:08.453588 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.453588 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:08.453588 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.453588 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.453588 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:08.453588 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.453588 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.455233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.455701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:08.467082 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:08.467681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:08.468227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:08.468484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.469283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:08.469283 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.469283 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:08.469283 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.469283 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.469283 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:08.469283 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.469283 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:08.470679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:08.472373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.473139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.474008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:08.474008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.474008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:08.663355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:08.663755 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:08.664645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:08.665121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.666258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:08.666258 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.666258 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:08.666258 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.666258 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.666258 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:08.666258 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.666258 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:08.667770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:08.668890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:08.668890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.668890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:08.668890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.668890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.668890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:08.668890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.668890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:08.669946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.670726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:08.671478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.671478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:08.754225 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:08.754632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:08.755301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:08.755599 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:08.755790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.756504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:08.756504 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.756504 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:08.756504 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.756504 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.756504 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:08.756504 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.756504 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.758115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:08.759134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:13.386867 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:13.387859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:13.399314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=326,neutron:UPDATE=1 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:16:13.418176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:13.418699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:13.419699 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.419699 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:13.419699 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.419699 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.419699 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:13.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.419699 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.420869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.421352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:13.451979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:13.453040 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:13.453371 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:13.453597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.454425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:13.454425 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.454425 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:13.454425 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.454425 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.454425 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:13.454425 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.454425 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.456225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.456997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:13.467551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:13.468094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:13.468622 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:13.468991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.469506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:13.469506 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.469506 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:13.469506 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.469506 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.469506 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:13.469506 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.469506 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:13.470332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.470872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:13.471309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.471948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.472485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:13.472485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.472485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:13.664417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:13.664417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:13.665527 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:13.665826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.666413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:13.666413 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.666413 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:13.666413 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.666413 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.666413 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:13.666413 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.666413 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:13.667339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:13.667672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:13.667672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.667672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:13.667672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.667672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.667672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:13.667672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.667672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:13.668384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.668728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:13.669090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.669090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:13.754756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:13.755067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:13.755518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:13.755918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:13.756161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.756924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:13.756924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.756924 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:13.756924 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.756924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.756924 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:13.756924 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.756924 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.758722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:13.759510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:18.387531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:18.388702 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:18.422602 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:18.422972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.423837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:18.423837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.423837 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:18.423837 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.423837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.423837 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:18.423837 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.423837 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.424769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.425595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:18.452604 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:18.453565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:18.453964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:18.454198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:18.455153 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.455153 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:18.455153 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.455153 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.455153 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:18.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.456374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.457291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:18.468060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:18.468452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:18.468941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:18.469225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.469966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:18.469966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.469966 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:18.469966 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.469966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.469966 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:18.469966 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.469966 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:18.470899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.471669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:18.472824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.473597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.474388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:18.474388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.474388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:18.664960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:18.665378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:18.666401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:18.666831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.667765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:18.667765 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.667765 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:18.667765 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.667765 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.667765 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:18.667765 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.667765 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:18.669001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:18.669972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:18.669972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.669972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:18.669972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.669972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.669972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:18.669972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.669972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:18.670738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.671542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:18.672426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.672426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:18.755304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:18.756402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:18.757092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:18.757486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:18.757748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.758637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:18.758637 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.758637 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:18.758637 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.758637 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.758637 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:18.758637 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.758637 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.760559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:18.761385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:23.388257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:23.389236 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:23.426466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:23.426934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.427822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:23.427822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.427822 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:23.427822 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.427822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.427822 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:23.427822 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.427822 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.429081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.429599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:23.453583 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:23.454882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:23.455282 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:23.455567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.456475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:23.456475 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.456475 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:23.456475 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.456475 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.456475 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:23.456475 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.456475 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.458311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.458834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:23.468941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:23.469844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:23.470293 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:23.470530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.471282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:23.471282 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.471282 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:23.471282 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.471282 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.471282 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:23.471282 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.471282 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:23.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.473333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:23.474560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.475079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.475587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:23.475587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.475587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:23.665637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:23.666214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:23.666941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:23.667381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.668378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:23.668378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.668378 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:23.668378 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.668378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.668378 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:23.668378 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.668378 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:23.669761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:23.670169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:23.670169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.670169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:23.670169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.670169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.670169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:23.670169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.670169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:23.671464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.671903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:23.672369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.672369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:23.756684 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:23.757312 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:23.757896 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:23.758290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:23.758522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.759318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:23.759318 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.759318 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:23.759318 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.759318 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.759318 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:23.759318 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.759318 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.760984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:23.761790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:28.388986 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:28.390653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:28.427472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:28.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:28.428803 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.428803 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:28.428803 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.428803 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.428803 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:28.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.429993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.431001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:28.454249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:28.455337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:28.455681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:28.455911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.456690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:28.456690 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.456690 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:28.456690 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.456690 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.456690 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:28.456690 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.456690 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.458640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.459383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:28.469401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:28.470029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:28.470543 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:28.470845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.471566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:28.471566 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.471566 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:28.471566 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.471566 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.471566 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:28.471566 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.471566 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:28.472961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.473763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:28.474502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.475281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.476123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:28.476123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.476123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:28.666569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:28.667448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:28.668269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:28.668767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.669629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:28.669629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.669629 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:28.669629 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.669629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.669629 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:28.669629 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.669629 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:28.670918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:28.671734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:28.671734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.671734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:28.671734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.671734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.671734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:28.671734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.671734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:28.672558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.673362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:28.674182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.674182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:28.757546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:28.758218 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:28.759008 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:28.759428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:28.759690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.760568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:28.760568 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.760568 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:28.760568 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.760568 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.760568 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:28.760568 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.760568 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.762453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:28.763105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:33.389735 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:33.391224 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:33.426831 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:33.427086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.427968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:33.427968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.427968 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:33.427968 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.427968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.427968 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:33.427968 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.427968 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.429827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:33.454904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:33.456885 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:33.457238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:33.457491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.458412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:33.458412 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.458412 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:33.458412 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.458412 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.458412 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:33.458412 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.458412 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.460531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.461600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:33.469905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:33.470445 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:33.470880 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:33.471091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.471741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:33.471741 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.471741 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:33.471741 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.471741 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.471741 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:33.471741 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.471741 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:33.473196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.473651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:33.474927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.475405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.475943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:33.475943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.475943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:33.667775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:33.668359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:33.669266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:33.669864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.670859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:33.670859 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.670859 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:33.670859 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.670859 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.670859 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:33.670859 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.670859 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:33.672316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:33.672792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:33.672792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.672792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:33.672792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.672792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.672792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:33.672792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.672792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:33.674103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:33.675127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.675127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:33.758289 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:33.758936 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:33.759650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:33.760196 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:33.760494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.761483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:33.761483 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.761483 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:33.761483 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.761483 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.761483 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:33.761483 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.761483 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.763497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:33.764911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:38.390429 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:38.392201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:38.427764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:38.427990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.428516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:38.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:38.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.428516 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:38.428516 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.428516 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.429551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.430429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:38.455420 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:38.456763 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:38.457078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:38.457262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.457808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:38.457808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.457808 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:38.457808 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.457808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.457808 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:38.457808 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.457808 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.459271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.459806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:38.470360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:38.471104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:38.471693 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:38.471983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.472779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:38.472779 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.472779 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:38.472779 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.472779 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.472779 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:38.472779 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.472779 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:38.474226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.475195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:38.476091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.476896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.477810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:38.477810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.477810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:38.668479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:38.668765 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:38.669307 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:38.669596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.670147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:38.670147 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.670147 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:38.670147 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.670147 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.670147 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:38.670147 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.670147 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:38.670889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:38.671353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:38.671353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.671353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:38.671353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.671353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.671353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:38.671353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.671353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:38.671905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.672415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:38.672968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.672968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:38.759041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:38.759752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:38.760368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:38.760807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:38.761035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.761858 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:38.761858 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.761858 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:38.761858 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.761858 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.761858 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:38.761858 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.761858 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.763637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:38.764486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:43.391675 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:43.392239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:43.419197 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:43.419360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.420170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:43.420170 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.420170 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:43.420170 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.420170 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.420170 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:43.420170 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.420170 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.421759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.422485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:43.456237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:43.457872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:43.458198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:43.458434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.461013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:43.462073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.463218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.463218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:43.463218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.463218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:43.470971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:43.471485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:43.472076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:43.472437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.473562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:43.473562 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.473562 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:43.473562 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.473562 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.473562 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:43.473562 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.473562 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:43.474681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.475136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:43.475717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.476182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.476705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:43.476705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.476705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:43.669279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:43.671875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:43.674201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:43.674201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.674491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:43.674491 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.674491 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:43.674491 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.674491 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.674491 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:43.674491 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.674491 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:43.675418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:43.676283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:43.676283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.676283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:43.676283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.676283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.676283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:43.676283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.676283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:43.676671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.677599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:43.678505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.678505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:43.759767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:43.760924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:43.761651 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:43.761858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:43.762000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.762528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:43.762528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.762528 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:43.762528 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.762528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.762528 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:43.762528 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.762528 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.763851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:43.764901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:48.391960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:48.393453 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:48.428545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:48.428795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.429348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:48.429348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.429348 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:48.429348 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.429348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.429348 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:48.429348 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.429348 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.430495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.431057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:48.456954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:48.471408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:48.471949 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:48.476775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:48.476775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:48.476775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.477209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:48.477209 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.477209 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:48.477209 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.477209 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.477209 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:48.477209 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.477209 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.478725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.479640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.480391 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:48.481184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.482074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:48.482846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.483713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.484503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:48.484503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.484503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:48.672546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:48.673078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:48.673802 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:48.674223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.675113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:48.675113 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.675113 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:48.675113 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.675113 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.675113 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:48.675113 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.675113 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:48.676484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:48.677369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:48.677369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.677369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:48.677369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.677369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.677369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:48.677369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.677369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:48.678265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.679273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:48.680139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.680139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:48.761136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:48.761767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:48.762342 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:48.762791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:48.763066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.763911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:48.763911 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.763911 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:48.763911 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.763911 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.763911 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:48.763911 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.763911 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.765557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:48.766325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:53.392737 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:53.393706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:53.421570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:53.421967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.422791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:53.422791 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.422791 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:53.422791 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.422791 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.422791 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:53.422791 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.422791 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.424027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.424861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:53.457506 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:53.458611 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:53.458908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:53.459146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.459977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:53.459977 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.459977 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:53.459977 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.459977 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.459977 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:53.459977 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.459977 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.461727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:53.471782 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:53.472326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:53.472914 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:53.473191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.473992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:53.473992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.473992 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:53.473992 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.473992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.473992 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:53.473992 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.473992 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:53.475327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.476073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:53.476872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.477775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.478673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:53.478673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.478673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:53.673242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:53.673803 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:53.674628 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:53.675074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.675909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:53.675909 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.675909 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:53.675909 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.675909 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.675909 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:53.675909 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.675909 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:53.677233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:53.677991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:53.677991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.677991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:53.677991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.677991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.677991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:53.677991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.677991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:53.678924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.679714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:53.680478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.680478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:53.761831 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:53.763150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:53.763814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:53.764245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:53.764558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.765740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:53.765740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.765740 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:53.765740 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.765740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.765740 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:53.765740 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.765740 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.768338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:53.769711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:58.393322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:58.394940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:58.429648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:58.430101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:16:58.430993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.430993 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:58.430993 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.430993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.430993 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:58.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.431957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.432836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:58.458076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:58.459184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:58.459503 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:58.459826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.460584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:58.460584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.460584 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:58.460584 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.460584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.460584 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:58.460584 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.460584 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.462745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.463538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:58.472124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:58.472517 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:16:58.473009 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:58.473277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.474004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:16:58.474004 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.474004 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:58.474004 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.474004 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.474004 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:58.474004 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.474004 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:58.474711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:58.475482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.476201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.477048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:58.674123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:58.674580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:58.675361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:58.675814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.676675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:58.676675 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.676675 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:58.676675 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.676675 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.676675 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:58.676675 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.676675 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:16:58.677906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:58.678656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:16:58.678656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.678656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:16:58.678656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.678656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.678656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:16:58.678656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.678656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:16:58.679594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.680247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:58.680752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.680752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:16:58.762443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:16:58.763075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:16:58.763696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:58.764093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:16:58.764307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.765349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:16:58.765349 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.765349 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:16:58.765349 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.765349 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.765349 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:16:58.765349 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.765349 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.766997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:16:58.767795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:03.394233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:03.395809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:03.432108 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:03.432284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.432891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:03.432891 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.432891 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:03.432891 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.432891 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.432891 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:03.432891 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.432891 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.435036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:03.458683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:03.460576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:03.461142 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:03.461479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.462792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Traceback (most recent call last):
Apr 08 13:17:03.462792 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.462792 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:03.462792 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.462792 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.462792 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:03.462792 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.462792 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:03.464948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.465875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:03.474858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:03.475432 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:03.476324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:03.477904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.478887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:03.478887 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.478887 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:03.478887 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.478887 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.478887 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:03.478887 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.478887 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:03.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.481170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:03.481921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.482743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.483559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:03.483559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.483559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:03.704840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:03.705327 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:03.706470 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:03.707025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.708066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:03.708066 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.708066 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:03.708066 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.708066 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.708066 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:03.708066 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.708066 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:03.709408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:03.710192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:03.710192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.710192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:03.710192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.710192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.710192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:03.710192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.710192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:03.711049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.711861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:03.712770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.712770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:03.763094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:03.763729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:03.764558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:03.765041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:03.765364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.766342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:03.766342 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.766342 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:03.766342 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.766342 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.766342 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:03.766342 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.766342 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.768345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:03.769230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:08.395181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:08.396925 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:08.427328 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:08.427793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.428671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:08.428671 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.428671 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:08.428671 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.428671 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.428671 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:08.428671 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.428671 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.429640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.447589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:08.460026 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:08.461012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:08.461235 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:08.461397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.462113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:08.462113 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.462113 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:08.462113 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.462113 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.462113 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:08.462113 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.462113 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.463296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.464759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:08.475325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:08.475698 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:08.476092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:08.476309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.477038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:08.477038 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.477038 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:08.477038 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.477038 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.477038 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:08.477038 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.477038 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:08.478244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.478543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:08.479896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.480235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.480600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:08.480600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.480600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:08.705443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:08.706028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:08.706815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:08.707449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.708408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:08.708408 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.708408 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:08.708408 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.708408 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.708408 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:08.708408 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.708408 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:08.709995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:08.710712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:08.710712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.710712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:08.710712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.710712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.710712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:08.710712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.710712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:08.711694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.712198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:08.712781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.712781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:08.765772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:08.766365 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:08.766934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:08.767328 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:08.767583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.768332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:08.768332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.768332 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:08.768332 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.768332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.768332 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:08.768332 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.768332 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.770265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:08.771121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:13.396034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:13.397524 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:13.411340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:17:13.436906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:13.437172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.438206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:13.438206 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.438206 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:13.438206 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.438206 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.438206 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:13.438206 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.438206 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.439114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.439676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:13.460513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:13.461644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:13.461821 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:13.462003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.462689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:13.462689 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.462689 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:13.462689 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.462689 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.462689 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:13.462689 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.462689 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.464432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.465374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:13.475817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:13.476384 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:13.476803 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:13.477004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.477646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:13.477646 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.477646 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:13.477646 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.477646 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.477646 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:13.477646 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.477646 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:13.479312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.480470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:13.481654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.483457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:13.483457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.483457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:13.706085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:13.706576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:13.707284 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:13.707565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.708603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:13.708603 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.708603 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:13.708603 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.708603 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.708603 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:13.708603 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.708603 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:13.709531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:13.710287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:13.710287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.710287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:13.710287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.710287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.710287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:13.710287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.710287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:13.711163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.711963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:13.712927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.712927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:13.766212 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:13.767014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:13.767403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:13.767632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:13.767810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.768509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:13.768509 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.768509 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:13.768509 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.768509 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.768509 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:13.768509 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.768509 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.770229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:13.773347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:18.396516 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:18.398176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:18.436990 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:18.437474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.438389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:18.438389 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.438389 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:18.438389 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.438389 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.438389 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:18.438389 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.438389 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.439335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.440237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:18.461105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:18.462164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:18.462477 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:18.462768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.463504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:18.463504 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.463504 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:18.463504 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.463504 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.463504 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:18.463504 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.463504 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.465316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.466102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:18.476313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:18.476748 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:18.477220 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:18.477492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.478184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:18.478184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.478184 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:18.478184 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.478184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.478184 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:18.478184 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.478184 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:18.478874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.479516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:18.479965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.480644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.481442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:18.481442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.481442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:18.706751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:18.708077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:18.708179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:18.708594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.709394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:18.709394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.709394 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:18.709394 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.709394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.709394 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:18.709394 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.709394 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:18.710516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:18.711181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:18.711181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.711181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:18.711181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.711181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.711181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:18.711181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.711181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:18.711768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.712388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:18.713213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.713213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:18.766941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:18.767656 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:18.768168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:18.768514 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:18.768766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.769405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:18.769405 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.769405 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:18.769405 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.769405 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.769405 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:18.769405 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.769405 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.770497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:18.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:23.396948 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:23.399016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:23.447238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:23.447459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.448170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:23.448170 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.448170 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:23.448170 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.448170 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.448170 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:23.448170 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.448170 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.449416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.450345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:23.461726 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:23.465201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:23.465368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:23.465781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.466284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:23.466284 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.466284 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:23.466284 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.466284 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.466284 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:23.466284 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.466284 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.467482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.467838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:23.476739 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:23.477352 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:23.478134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:23.478276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.479073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:23.479073 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.479073 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:23.479073 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.479073 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.479073 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:23.479073 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.479073 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:23.479989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.480743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:23.481440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.482193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.483004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:23.483004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.483004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:23.707448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:23.707927 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:23.708634 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:23.709095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.710001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:23.710001 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.710001 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:23.710001 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.710001 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.710001 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:23.710001 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.710001 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:23.711359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:23.712129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:23.712129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.712129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:23.712129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.712129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.712129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:23.712129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.712129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:23.712962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.713742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:23.714498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.714498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:23.767719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:23.768264 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:23.768760 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:23.769148 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:23.769523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.770294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:23.770294 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.770294 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:23.770294 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.770294 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.770294 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:23.770294 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.770294 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:23.772274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:28.397542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:28.399242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:28.434371 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:28.434865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:28.435822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.435822 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:28.435822 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.435822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.435822 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:28.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.435822 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.437007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.437758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:28.464437 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:28.465467 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:28.465798 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:28.466037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.466826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:28.466826 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.466826 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:28.466826 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.466826 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.466826 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:28.466826 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.466826 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.468602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.469502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:28.477100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:28.477600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:28.478046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:28.478324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.479017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:28.479017 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.479017 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:28.479017 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.479017 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.479017 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:28.479017 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.479017 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:28.479911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.480694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:28.481071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.481761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.482480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:28.482480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.482480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:28.707965 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:28.708179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:28.708576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:28.708790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.709291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:28.709291 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.709291 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:28.709291 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.709291 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.709291 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:28.709291 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.709291 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:28.709930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:28.710284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:28.710284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.710284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:28.710284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.710284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.710284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:28.710284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.710284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:28.710644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.710988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:28.711406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.711406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:28.768241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:28.768809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:28.769513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:28.770025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:28.770249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.771047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:28.771047 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.771047 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:28.771047 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.771047 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.771047 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:28.771047 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.771047 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.772828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:28.773317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:33.398198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:33.400205 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:33.443775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:33.444179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.445288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:33.445288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.445288 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:33.445288 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.445288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.445288 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:33.445288 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.445288 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.447048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.447953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:33.465083 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:33.467724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:33.468097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:33.468372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.469348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:33.469348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.469348 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:33.469348 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.469348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.469348 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:33.469348 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.469348 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.471502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.472070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:33.477606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:33.478153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:33.478696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:33.479039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.480038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:33.480038 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.480038 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:33.480038 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.480038 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.480038 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:33.480038 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.480038 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:33.481571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.482340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:33.483057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.483781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.484658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:33.484658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.484658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:33.708607 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:33.738233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:33.739639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:33.739838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.740245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:33.740245 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.740245 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:33.740245 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.740245 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.740245 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:33.740245 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.740245 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:33.740920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:33.741699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:33.741699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.741699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:33.741699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.741699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.741699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:33.741699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.741699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:33.742212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.742869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:33.743286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.743286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:33.768606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:33.769520 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:33.770316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:33.770569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:33.770758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.771409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:33.771409 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.771409 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:33.771409 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.771409 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.771409 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:33.771409 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.771409 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.773295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:33.774243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:38.398990 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:38.400551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:38.444020 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:38.444404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.445308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:17:38.445308 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.445308 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:38.445308 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.445308 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.445308 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:38.445308 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.445308 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.446179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.446958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:38.466339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:38.467281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:38.467650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:38.467921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.468790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:38.468790 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.468790 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:38.468790 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.468790 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.468790 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:38.468790 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.468790 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:38.470508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.470982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:38.478457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:38.478777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:38.479223 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:38.479306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.479956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:38.479956 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.479956 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:38.479956 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.479956 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.479956 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:38.479956 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.479956 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:38.480607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.481137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:38.481687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.482152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.482733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:38.482733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.482733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:38.738456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:38.739273 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:38.739969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:38.740659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.781314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:38.782121 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:38.782838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:38.782838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.782838 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:38.782838 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.782838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.782838 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:38.782838 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.782838 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:38.783754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:38.784063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:38.784063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.784063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:38.784063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.784063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.784063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:38.784063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.784063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:38.784666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.784980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:38.785306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.785306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:38.785306 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:38.785368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:38.785502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.786018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:38.786018 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.786018 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:38.786018 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.786018 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.786018 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:38.786018 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.786018 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.786909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:38.787224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:43.399807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:43.401393 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:43.438523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:43.438929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.439713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:17:43.439713 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.439713 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:43.439713 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.439713 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.439713 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:43.439713 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.439713 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.440639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.441378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:43.466776 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:43.467747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:43.468092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:43.468312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.469111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:43.469111 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.469111 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:43.469111 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.469111 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.469111 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:43.469111 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.469111 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:43.470165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.470669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:43.478700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:43.479169 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:43.479639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:43.479980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.480916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:17:43.480916 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.480916 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:43.480916 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.480916 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.480916 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:43.480916 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.480916 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:43.482156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.482813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:43.484273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.484682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.485136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:43.485136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.485136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:43.739175 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:43.739481 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:43.740175 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:43.740446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.741185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:43.741185 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.741185 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:43.741185 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.741185 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.741185 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:43.741185 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.741185 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:43.742693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:43.743330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:43.743330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.743330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:43.743330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.743330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.743330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:43.743330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.743330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:43.744520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.745211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:43.745968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.745968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:43.781746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:43.782072 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:43.782500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:43.782822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:43.783011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.783811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:43.783811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.783811 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:43.783811 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.783811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.783811 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:43.783811 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.783811 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:43.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:48.400514 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:48.402001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:48.439427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:48.439999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.441721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:17:48.441721 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.441721 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:48.441721 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.441721 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.441721 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:48.441721 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.441721 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.442594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.443542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:48.467294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:48.468299 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:48.468649 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:48.468946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.469789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:48.469789 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.469789 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:48.469789 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.469789 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.469789 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:48.469789 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.469789 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:48.470793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.471593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:48.479168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:48.480328 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:48.481018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:48.481322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.482176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Traceback (most recent call last):
Apr 08 13:17:48.482176 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.482176 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:48.482176 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.482176 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.482176 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:48.482176 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.482176 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:48.483864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.484584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:48.485506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.486299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.486906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:48.486906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.486906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:48.739846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:48.740399 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:48.741286 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:48.741810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.742716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:48.742716 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.742716 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:48.742716 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.742716 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.742716 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:48.742716 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.742716 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:48.744131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:48.744877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:48.744877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.744877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:48.744877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.744877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.744877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:48.744877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.744877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:48.745910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.746658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:48.747478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.747478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:48.782167 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:48.782754 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:48.783379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:48.783884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:48.784592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.785150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:48.785150 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.785150 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:48.785150 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.785150 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.785150 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:48.785150 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.785150 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.787317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:48.788120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:53.401219 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:53.402801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:53.435295 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:53.436127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.436562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:17:53.436562 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.436562 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:53.436562 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.436562 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.436562 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:53.436562 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.436562 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.438404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.439297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:53.467772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:53.468770 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:53.469116 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:53.469354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.470352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:53.470352 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.470352 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:53.470352 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.470352 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.470352 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:53.470352 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.470352 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:53.471299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.472299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:53.480021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:53.480543 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:53.481385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:53.481703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.482462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:17:53.482462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.482462 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:53.482462 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.482462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.482462 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:53.482462 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.482462 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:53.483875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.484451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:53.485850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.486290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.486894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:53.486894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.486894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:53.740522 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:53.741127 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:53.741970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:53.742403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.743288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:53.743288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.743288 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:53.743288 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.743288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.743288 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:53.743288 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.743288 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:53.744646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:53.745456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:53.745456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.745456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:53.745456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.745456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.745456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:53.745456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.745456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:53.746179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.747014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:53.747717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.747717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:53.782638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:53.783142 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:53.783621 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:53.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:53.784284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.785158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:53.785158 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.785158 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:53.785158 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.785158 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.785158 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:53.785158 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.785158 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.786826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:53.787546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:58.401670 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:58.402863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:58.435311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:58.435747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.436608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:17:58.436608 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.436608 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:58.436608 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.436608 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.436608 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:58.436608 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.436608 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.437787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.438825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:58.468318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:58.469465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:58.469834 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:58.470074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.471062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:17:58.471062 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.471062 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:58.471062 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.471062 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.471062 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:58.471062 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.471062 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:58.473101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:58.480415 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:58.480802 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:17:58.481183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:58.481361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.481935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:17:58.481935 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.481935 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:58.481935 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.481935 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.481935 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:58.481935 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.481935 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:58.483164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.483911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:17:58.484694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.485480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.486396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:58.486396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.486396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:58.741261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:58.741909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:58.742768 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:58.743197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.744054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:58.744054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.744054 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:58.744054 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.744054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.744054 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:58.744054 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.744054 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:17:58.745361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:58.746090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:17:58.746090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.746090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:17:58.746090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.746090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.746090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:17:58.746090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.746090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:17:58.746996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.747785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:58.748272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.748272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:17:58.783250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:17:58.783680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:17:58.784045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:58.784376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:17:58.784588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.785244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:17:58.785244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.785244 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:17:58.785244 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.785244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.785244 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:17:58.785244 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.785244 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.786786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:17:58.787834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:03.402362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:03.403938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:03.441450 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:03.441917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.442837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:03.442837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.442837 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:03.442837 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.442837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.442837 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:03.442837 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.442837 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.443675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.444578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:03.468978 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:03.469893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:03.470278 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:03.470503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.471377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:03.471377 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.471377 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:03.471377 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.471377 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.471377 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:03.471377 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.471377 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:03.473141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.474148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:03.480874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:03.481407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:03.481833 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:03.482026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.482708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:03.482708 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.482708 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:03.482708 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.482708 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.482708 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:03.482708 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.482708 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:03.483995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.484504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:03.485645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.486702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.487492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:03.487492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.487492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:03.741970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:03.742636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:03.743515 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:03.743990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.744902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:03.744902 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.744902 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:03.744902 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.744902 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.744902 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:03.744902 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.744902 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:03.746499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:03.747536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:03.747536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.747536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:03.747536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.747536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.747536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:03.747536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.747536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:03.748869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.749830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:03.750682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.750682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:03.783732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:03.784261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:03.784625 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:03.784936 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:03.785095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.785577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:03.785577 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.785577 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:03.785577 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.785577 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.785577 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:03.785577 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.785577 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.786785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:03.787680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:08.403170 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:08.404786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:08.439042 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:08.439300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.440168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:08.440168 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.440168 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:08.440168 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.440168 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.440168 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:08.440168 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.440168 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.440947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.441820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:08.469639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:08.470400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:08.470656 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:08.470829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.471507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:08.471507 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.471507 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:08.471507 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.471507 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.471507 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:08.471507 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.471507 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:08.472759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.473501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:08.481436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:08.482071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:08.482495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:08.482827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.485570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.486209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:08.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.488160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.488720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:08.488720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.488720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:08.742804 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:08.743349 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:08.744106 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:08.744495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.745327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:08.745327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.745327 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:08.745327 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.745327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.745327 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:08.745327 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.745327 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:08.746821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:08.747587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:08.747587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.747587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:08.747587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.747587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.747587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:08.747587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.747587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:08.748833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.749827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:08.750834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.750834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:08.784511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:08.785071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:08.785538 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:08.785916 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:08.786228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.786957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:08.786957 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.786957 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:08.786957 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.786957 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.786957 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:08.786957 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.786957 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.787860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:08.788694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:13.403846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:13.405823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:13.419336 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:18:13.441354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:13.442133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.442676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:13.442676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.442676 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:13.442676 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.442676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.442676 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:13.442676 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.442676 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.444306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.445119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:13.470229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:13.471319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:13.471645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:13.471909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.472778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:13.472778 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.472778 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:13.472778 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.472778 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.472778 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:13.472778 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.472778 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:13.474533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.475276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:13.482027 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:13.482476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:13.482971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:13.483243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.483970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:13.483970 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.483970 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:13.483970 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.483970 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.483970 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:13.483970 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.483970 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:13.485063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.485525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:13.486634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.487093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.487674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:13.487674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.487674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:13.743403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:13.743939 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:13.744788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:13.745277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.746252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:13.746252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.746252 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:13.746252 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.746252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.746252 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:13.746252 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.746252 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:13.747578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:13.748668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:13.748668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.748668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:13.748668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.748668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.748668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:13.748668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.748668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:13.749192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.750247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:13.751022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.751022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:13.785154 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:13.785517 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:13.786085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:13.786544 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:13.786879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.787772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:13.787772 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.787772 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:13.787772 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.787772 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.787772 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:13.787772 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.787772 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:13.790181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:18.404501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:18.405911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:18.443216 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:18.443583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:18.444434 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.444434 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:18.444434 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.444434 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.444434 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:18.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.445378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.446400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:18.470742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:18.472075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:18.472336 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:18.472504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.473413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:18.473413 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.473413 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:18.473413 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.473413 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.473413 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:18.473413 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.473413 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:18.475550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.476645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:18.482485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:18.482903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:18.483508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:18.483871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.484603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:18.484603 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.484603 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:18.484603 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.484603 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.484603 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:18.484603 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.484603 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:18.485582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.486050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:18.486637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.487075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.487559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:18.487559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.487559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:18.744338 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:18.745039 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:18.745999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:18.746434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.747357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:18.747357 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.747357 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:18.747357 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.747357 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.747357 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:18.747357 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.747357 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:18.748760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:18.749458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:18.749458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.749458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:18.749458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.749458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.749458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:18.749458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.749458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:18.750462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.751222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:18.752052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.752052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:18.785595 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:18.786147 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:18.786627 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:18.787093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:18.787337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.788078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:18.788078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.788078 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:18.788078 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.788078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.788078 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:18.788078 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.788078 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.789714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:18.790430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:23.405156 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:23.406833 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:23.437662 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:23.437933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.438631 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:23.438631 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.438631 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:23.438631 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.438631 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.438631 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:23.438631 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.438631 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.440249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:23.471524 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:23.474259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:23.474604 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:23.474847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.475869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:23.475869 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.475869 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:23.475869 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.475869 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.475869 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:23.475869 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.475869 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:23.477082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.477933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:23.482946 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:23.483405 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:23.483889 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:23.484168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.484983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:23.484983 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.484983 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:23.484983 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.484983 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.484983 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:23.484983 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.484983 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:23.486303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.486742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:23.488040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.488544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.489041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:23.489041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.489041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:23.745083 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:23.745716 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:23.746443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:23.746887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.747714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:23.747714 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.747714 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:23.747714 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.747714 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.747714 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:23.747714 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.747714 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:23.749214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:23.750055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:23.750055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.750055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:23.750055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.750055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.750055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:23.750055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.750055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:23.751134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.752035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:23.752923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.752923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:23.786413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:23.787159 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:23.787971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:23.788357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:23.788581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.789668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:23.789668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.789668 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:23.789668 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.789668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.789668 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:23.789668 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.789668 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.790880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:23.791816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:28.406034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:28.407330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:28.444497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:28.444914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.446014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:28.446014 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.446014 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:28.446014 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.446014 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.446014 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:28.446014 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.446014 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.447118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.447983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:28.473589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:28.474970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:28.475357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:28.475627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.476730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:28.476730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.476730 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:28.476730 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.476730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.476730 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:28.476730 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.476730 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:28.479120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.480009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:28.483414 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:28.483904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:28.484344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:28.484657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.485607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:28.485607 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.485607 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:28.485607 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.485607 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.485607 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:28.485607 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.485607 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:28.487111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.487672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:28.488985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.490149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:28.490149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.490149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:28.745947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:28.746452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:28.747074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:28.747341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.747924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:28.747924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.747924 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:28.747924 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.747924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.747924 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:28.747924 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.747924 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:28.749270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:28.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:28.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:28.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:28.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.750031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:28.751180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.751981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:28.752782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.752782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:28.787183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:28.787758 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:28.788326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:28.788756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:28.789049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.789773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:28.789773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.789773 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:28.789773 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.789773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.789773 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:28.789773 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.789773 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.790923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:28.791712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:33.406723 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:33.408213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:33.444004 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:33.444196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.444867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:33.444867 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.444867 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:33.444867 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.444867 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.444867 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:33.444867 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.444867 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.446008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.447191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:33.474107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:33.475222 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:33.475493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:33.475754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.476638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:33.476638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.476638 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:33.476638 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.476638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.476638 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:33.476638 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.476638 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:33.478366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.479102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:33.483874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:33.484325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:33.484758 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:33.485085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.485800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:33.485800 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.485800 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:33.485800 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.485800 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.485800 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:33.485800 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.485800 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:33.486950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.487734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:33.488512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.489316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.490200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:33.490200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.490200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:33.746439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:33.747025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:33.747642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:33.748053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.748904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:33.748904 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.748904 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:33.748904 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.748904 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.748904 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:33.748904 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.748904 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:33.750243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:33.751034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:33.751034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.751034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:33.751034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.751034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.751034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:33.751034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.751034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:33.751792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.752467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:33.753437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.753437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:33.787973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:33.788503 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:33.789063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:33.789423 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:33.789605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.790331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:33.790331 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.790331 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:33.790331 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.790331 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.790331 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:33.790331 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.790331 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.791653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:33.792457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:38.407443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:38.409636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:38.443417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:38.443661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.444366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:38.444366 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.444366 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:38.444366 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.444366 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.444366 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:38.444366 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.444366 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.445586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.447334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:38.474548 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:38.475921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:38.476282 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:38.476501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.477598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:38.477598 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.477598 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:38.477598 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.477598 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.477598 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:38.477598 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.477598 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:38.479428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.480459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:38.484295 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:38.484830 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:38.485514 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:38.485776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.486348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:38.486348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.486348 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:38.486348 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.486348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.486348 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:38.486348 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.486348 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:38.488850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:38.489708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.490395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.491218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:38.747134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:38.747513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:38.748053 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:38.748441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.749244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:38.749244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.749244 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:38.749244 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.749244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.749244 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:38.749244 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.749244 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:38.750396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:38.751116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:38.751116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.751116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:38.751116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.751116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.751116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:38.751116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.751116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:38.751948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.752711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:38.753471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.753471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:38.788379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:38.789050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:38.789474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:38.789835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:38.790045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.790787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:38.790787 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.790787 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:38.790787 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.790787 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.790787 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:38.790787 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.790787 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.792650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:38.793391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:43.408470 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:43.410089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:43.446983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:43.447324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.448040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:43.448040 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.448040 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:43.448040 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.448040 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.448040 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:43.448040 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.448040 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.448861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.449721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:43.475112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:43.476032 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:43.476340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:43.476596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.477401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:43.477401 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.477401 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:43.477401 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.477401 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.477401 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:43.477401 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.477401 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:43.479106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.479876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:43.484730 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:43.484960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:43.485251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:43.485374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.485942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:43.485942 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.485942 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:43.485942 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.485942 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.485942 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:43.485942 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.485942 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:43.486741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.487259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:43.487756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.488516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.489022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:43.489022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.489022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:43.747678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:43.748058 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:43.748632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:43.749065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.750030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:43.750030 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.750030 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:43.750030 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.750030 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.750030 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:43.750030 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.750030 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:43.751253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:43.752076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:43.752076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.752076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:43.752076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.752076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.752076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:43.752076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.752076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:43.752974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.753754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:43.754594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.754594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:43.788888 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:43.789452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:43.789976 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:43.790337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:43.790562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.791291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:43.791291 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.791291 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:43.791291 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.791291 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.791291 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:43.791291 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.791291 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.793104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:43.793558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:48.409052 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:48.410607 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:48.446534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:48.446903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.447889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:48.447889 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.447889 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:48.447889 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.447889 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.447889 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:48.447889 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.447889 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.449093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.450287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:48.475609 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:48.476546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:48.476844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:48.477069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.477889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:48.477889 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.477889 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:48.477889 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.477889 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.477889 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:48.477889 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.477889 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:48.479652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.480768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:48.485085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:48.485369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:48.485729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:48.485916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.486498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:48.486498 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.486498 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:48.486498 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.486498 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.486498 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:48.486498 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.486498 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:48.487525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.488260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:48.488855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.489558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.490408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:48.490408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.490408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:48.748357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:48.749005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:48.749628 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:48.750114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.751121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:48.751121 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.751121 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:48.751121 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.751121 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.751121 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:48.751121 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.751121 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:48.752423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:48.753257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:48.753257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.753257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:48.753257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.753257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.753257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:48.753257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.753257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:48.754029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.754792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:48.755593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.755593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:48.789379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:48.789815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:48.790712 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:48.791003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:48.791230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.792143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:48.792143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.792143 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:48.792143 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.792143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.792143 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:48.792143 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.792143 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.793893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:48.794443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:53.409741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:53.411314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:53.441732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:53.442238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.443232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:53.443232 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.443232 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:53.443232 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.443232 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.443232 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:53.443232 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.443232 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.444180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.445138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:53.476174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:53.477178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:53.477436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:53.477692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.478462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:53.478462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.478462 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:53.478462 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.478462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.478462 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:53.478462 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.478462 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:53.480399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.481390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:53.485478 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:53.485845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:53.486562 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:53.486975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.487985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:53.487985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.487985 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:53.487985 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.487985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.487985 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:53.487985 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.487985 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:53.488914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:53.490080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.490632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.491174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:53.491174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.491174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:53.748988 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:53.749509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:53.750297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:53.750841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.751746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:53.751746 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.751746 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:53.751746 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.751746 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.751746 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:53.751746 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.751746 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:53.753047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:53.754036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:53.754036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.754036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:53.754036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.754036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.754036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:53.754036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.754036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:53.754553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.755293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:53.756185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.756185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:53.790016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:53.790594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:53.791199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:53.791662 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:53.792138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.792935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:53.792935 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.792935 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:53.792935 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.792935 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.792935 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:53.792935 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.792935 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.794484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:53.796023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:58.410718 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:58.412069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:58.446984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:58.447351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.448175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:18:58.448175 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.448175 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:58.448175 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.448175 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.448175 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:58.448175 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.448175 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.449049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.449388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:58.476480 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:58.477320 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:58.477631 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:58.477892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.478590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:18:58.478590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.478590 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:58.478590 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.478590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.478590 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:58.478590 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.478590 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:58.479367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.479681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:58.485807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:58.486106 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:18:58.486681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:58.486966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.487663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:18:58.487663 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.487663 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:58.487663 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.487663 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.487663 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:58.487663 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.487663 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:58.488608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.488896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:18:58.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.489990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.490338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:58.490338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.490338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:58.749588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:58.750248 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:58.751075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:58.751549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.752384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:58.752384 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.752384 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:58.752384 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.752384 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.752384 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:58.752384 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.752384 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:18:58.753762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:58.754232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:18:58.754232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.754232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:18:58.754232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.754232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.754232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:18:58.754232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.754232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:18:58.755607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.756044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:58.756524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.756524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:18:58.790676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:18:58.791263 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:18:58.791827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:58.792224 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:18:58.792475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.793289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:18:58.793289 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.793289 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:18:58.793289 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.793289 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.793289 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:18:58.793289 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.793289 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.795141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:18:58.795588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:03.411187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:03.412532 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:03.445993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:03.446413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.447327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:03.447327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.447327 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:03.447327 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.447327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.447327 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:03.447327 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.447327 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.448198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.449140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:03.476911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:03.477999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:03.478338 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:03.478584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.479503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:03.479503 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.479503 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:03.479503 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.479503 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.479503 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:03.479503 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.479503 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:03.481169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.481579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:03.486154 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:03.486565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:03.486994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:03.487206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.487987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:03.487987 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.487987 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:03.487987 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.487987 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.487987 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:03.487987 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.487987 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:03.489229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.490070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:03.490466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.491190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.492025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:03.492025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.492025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:03.750481 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:03.751171 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:03.751994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:03.752361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.753228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:03.753228 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.753228 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:03.753228 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.753228 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.753228 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:03.753228 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.753228 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:03.754556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:03.755226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:03.755226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.755226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:03.755226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.755226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.755226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:03.755226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.755226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:03.756317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.757014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:03.757805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.757805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:03.791238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:03.791958 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:03.792398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:03.792698 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:03.792857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.793462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:03.793462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.793462 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:03.793462 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.793462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.793462 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:03.793462 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.793462 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.795229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:03.795808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:08.411659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:08.413479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:08.452551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:08.452931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.454034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:08.454034 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.454034 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:08.454034 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.454034 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.454034 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:08.454034 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.454034 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.455153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.455928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:08.477351 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:08.481559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:08.481817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:08.481983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.482760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:08.482760 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.482760 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:08.482760 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.482760 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.482760 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:08.482760 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.482760 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:08.483659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.484464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:08.486928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:08.487298 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:08.487984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:08.488317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.489154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:08.489154 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.489154 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:08.489154 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.489154 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.489154 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:08.489154 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.489154 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:08.490322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.490760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:08.491838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.492260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.492731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:08.492731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.492731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:08.751226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:08.752024 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:08.752771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:08.753212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.757130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:08.757130 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.757130 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:08.757130 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.757130 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.757130 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:08.757130 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.757130 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:08.757824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.758732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:08.759472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.760370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:08.791903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:08.794931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:08.795408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:08.795874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:08.796206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.797041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:08.797041 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.797041 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:08.797041 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.797041 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.797041 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:08.797041 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.797041 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.797860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:08.799850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:13.412575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:13.413762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:13.426032 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:19:13.445783 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:13.446169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.447042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:13.447042 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.447042 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:13.447042 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.447042 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.447042 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:13.447042 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.447042 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.448147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.449020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:13.481098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:13.482429 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:13.482817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:13.483092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.484103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:13.484103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.484103 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:13.484103 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.484103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.484103 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:13.484103 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.484103 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:13.485949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.487126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:13.488229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:13.488229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:13.488370 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:13.488634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.489363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:13.489363 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.489363 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:13.489363 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.489363 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.489363 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:13.489363 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.489363 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:13.490548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.491074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:13.492114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.492676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.493231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:13.493231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.493231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:13.752326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:13.752933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:13.753643 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:13.754056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.754884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:13.754884 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.754884 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:13.754884 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.754884 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.754884 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:13.754884 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.754884 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:13.756115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:13.756579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:13.756579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.756579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:13.756579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.756579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.756579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:13.756579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.756579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:13.757714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.758064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:13.758441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.758441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:13.795073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:13.795529 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:13.796044 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:13.796396 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:13.796608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.797365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:13.797365 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.797365 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:13.797365 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.797365 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.797365 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:13.797365 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.797365 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.799279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:13.799648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:18.413351 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:18.414380 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:18.447833 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:18.448326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.449294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:18.449294 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.449294 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:18.449294 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.449294 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.449294 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:18.449294 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.449294 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.450165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.451420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:18.481593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:18.482827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:18.483145 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:18.483358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.484255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:18.484255 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.484255 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:18.484255 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.484255 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.484255 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:18.484255 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.484255 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:18.486141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.487183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:18.488300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:18.488300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:18.488804 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:18.489073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.489922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:18.489922 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.489922 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:18.489922 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.489922 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.489922 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:18.489922 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.489922 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:18.491157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.491835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:18.492717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.493309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.494122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:18.494122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.494122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:18.752940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:18.753541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:18.754168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:18.754578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.755399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:18.755399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.755399 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:18.755399 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.755399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.755399 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:18.755399 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.755399 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:18.756778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:18.757585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:18.757585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.757585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:18.757585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.757585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.757585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:18.757585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.757585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:18.758336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.759208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:18.760115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.760115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:18.795596 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:18.796180 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:18.796777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:18.797168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:18.797572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.798320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:18.798320 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.798320 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:18.798320 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.798320 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.798320 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:18.798320 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.798320 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.799379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:18.800561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:23.413926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:23.416291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:23.450098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:23.450535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:23.452784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:23.453330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.453858 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:23.453858 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.453858 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.453858 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:23.453858 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.453858 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:23.482354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:23.483748 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:23.484093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:23.484335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.485317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:23.485317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.485317 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:23.485317 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.485317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.485317 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:23.485317 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.485317 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:23.487066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.487491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:23.488222 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:23.488734 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:23.489118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:23.489384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.492054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.492554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:23.492976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.493390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.493903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:23.493903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.493903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:23.753599 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:23.754023 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:23.754632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:23.755055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.755730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:23.755730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.755730 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:23.755730 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.755730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.755730 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:23.755730 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.755730 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:23.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:23.756801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:23.756801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.756801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:23.756801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.756801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.756801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:23.756801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.756801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:23.757113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.757506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:23.758016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.758016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:23.796288 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:23.796556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:23.797012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:23.797347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:23.797566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.798220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:23.798220 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.798220 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:23.798220 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.798220 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.798220 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:23.798220 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.798220 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.799062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:23.799824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:28.415102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:28.418873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:28.458638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:28.459153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:28.461457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:28.462607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.463779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:28.463779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.463779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.463779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:28.463779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.463779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:28.483019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:28.484447 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:28.484800 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:28.485044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.486048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:28.486048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.486048 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:28.486048 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.486048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.486048 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:28.486048 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.486048 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:28.487738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.489849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.494021 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:28.494387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:28.496800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.500011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.503711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:28.754340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:28.754781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:28.755518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:28.755980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.756844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:28.756844 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.756844 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:28.756844 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.756844 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.756844 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:28.756844 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.756844 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:28.758217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:28.758886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:28.758886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.758886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:28.758886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.758886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.758886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:28.758886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.758886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:28.760249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.760725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:28.761234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.761234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:28.796790 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:28.797382 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:28.798071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:28.798465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:28.798725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.799495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:28.799495 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.799495 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:28.799495 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.799495 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.799495 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:28.799495 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.799495 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:28.801758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:33.417356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:33.418550 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:33.464965 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:33.465217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.466119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:33.466119 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.466119 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:33.466119 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.466119 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.466119 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:33.466119 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.466119 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.467530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.468818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:33.483649 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:33.484991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:33.485409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:33.485771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.486857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:33.486857 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.486857 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:33.486857 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.486857 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.486857 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:33.486857 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.486857 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:33.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.490217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:33.491231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:33.491231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:33.491969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:33.492140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.493124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:33.493124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.493124 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:33.493124 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.493124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.493124 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:33.493124 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.493124 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:33.494315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.494809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:33.495554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.496120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.496859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:33.496859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.496859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:33.755245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:33.755948 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:33.756374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:33.756699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.757328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:33.757328 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.757328 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:33.757328 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.757328 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.757328 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:33.757328 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.757328 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:33.758227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:33.759263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:33.759263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.759263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:33.759263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.759263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.759263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:33.759263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.759263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:33.759763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.760884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:33.762607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.762607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:33.797598 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:33.798622 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:33.799171 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:33.799504 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:33.799724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.802945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:33.804524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:33.805804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:33.805804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:33.805804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:33.805804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:38.418069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:38.419360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:38.446638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:38.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.447743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:38.447743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.447743 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:38.447743 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.447743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.447743 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:38.447743 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.447743 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.448555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.449133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:38.484290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:38.485395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:38.485545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:38.485682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.486332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:38.486332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.486332 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:38.486332 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.486332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.486332 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:38.486332 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.486332 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:38.488248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.488764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:38.491001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:38.491558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:38.491954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:38.492101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.492586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:38.492586 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.492586 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:38.492586 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.492586 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.492586 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:38.492586 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.492586 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:38.493954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.494398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:38.495501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.495961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.496447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:38.496447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.496447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:38.755872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:38.756406 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:38.757046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:38.757451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.758428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:38.758428 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.758428 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:38.758428 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.758428 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.758428 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:38.758428 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.758428 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:38.760080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:38.760935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:38.760935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.760935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:38.760935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.760935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.760935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:38.760935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.760935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:38.761386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.762199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:38.763247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.763247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:38.798370 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:38.798861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:38.799717 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:38.800148 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:38.800399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:38.801262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.801262 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:38.801262 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.801262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.801262 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:38.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.801262 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.802046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:38.802840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:43.418849 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:43.420133 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:43.459761 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:43.459761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.460213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:43.460213 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.460213 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:43.460213 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.460213 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.460213 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:43.460213 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.460213 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.461453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.462001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:43.484881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:43.486828 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:43.487084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:43.487309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.488323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:43.488323 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.488323 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:43.488323 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.488323 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.488323 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:43.488323 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.488323 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:43.489522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.490403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:43.491777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:43.492051 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:43.494784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:43.495002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.495678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:43.495678 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.495678 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:43.495678 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.495678 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.495678 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:43.495678 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.495678 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:43.497026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.497491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:43.498590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.499118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.499790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:43.499790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.499790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:43.756509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:43.756938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:43.757826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:43.758317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.759221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:43.759221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.759221 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:43.759221 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.759221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.759221 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:43.759221 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.759221 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:43.760644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:43.761410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:43.761410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.761410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:43.761410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.761410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.761410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:43.761410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.761410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:43.762409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.763345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:43.764219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.764219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:43.798896 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:43.799372 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:43.800100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:43.800497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:43.800761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.801727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:43.801727 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.801727 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:43.801727 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.801727 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.801727 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:43.801727 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.801727 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.803537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:43.804345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:48.419680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:48.420935 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:48.457127 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:48.457878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.459020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:48.459020 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.459020 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:48.459020 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.459020 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.459020 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:48.459020 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.459020 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.460826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.461900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:48.486215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:48.487473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:48.487741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:48.487887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.488455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:48.488455 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.488455 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:48.488455 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.488455 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.488455 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:48.488455 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.488455 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:48.489571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.490441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:48.491885 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:48.492198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:48.492660 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:48.492867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.493423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:48.493423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.493423 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:48.493423 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.493423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.493423 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:48.493423 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.493423 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:48.494488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.495248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:48.495675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.496363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.497350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:48.497350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.497350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:48.757133 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:48.759055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:48.759839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:48.760324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.761110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:48.761110 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.761110 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:48.761110 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.761110 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.761110 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:48.761110 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.761110 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:48.761770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:48.762216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:48.762216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.762216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:48.762216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.762216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.762216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:48.762216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.762216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:48.762601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.763025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:48.763582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.763582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:48.799990 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:48.800347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:48.801018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:48.801374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:48.801663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.802477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:48.802477 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.802477 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:48.802477 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.802477 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.802477 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:48.802477 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.802477 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.803327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:48.803834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:53.420471 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:53.422030 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:53.458373 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:53.458660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.459462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:53.459462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.459462 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:53.459462 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.459462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.459462 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:53.459462 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.459462 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.460326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.461282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:53.486796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:53.488149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:53.488439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:53.488727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:53.489536 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.489536 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:53.489536 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.489536 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.489536 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:53.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.489536 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:53.491460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.492128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:53.492638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:53.492690 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:53.493112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:53.493290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.493940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:53.493940 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.493940 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:53.493940 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.493940 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.493940 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:53.493940 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.493940 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:53.495500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.496306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:53.497206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.497976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.498787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:53.498787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.498787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:53.759477 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:53.759731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:53.760633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:53.760952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.761630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:53.761630 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.761630 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:53.761630 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.761630 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.761630 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:53.761630 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.761630 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:53.762833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:53.763675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:53.763675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.763675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:53.763675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.763675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.763675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:53.763675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.763675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:53.764570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.765282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:53.766088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.766088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:53.800287 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:53.800911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:53.801266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:53.801498 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:53.801677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.802316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:53.802316 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.802316 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:53.802316 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.802316 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.802316 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:53.802316 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.802316 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.803967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:53.804970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:58.421342 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:58.422572 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:58.465100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:58.465257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.466023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:19:58.466023 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.466023 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:58.466023 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.466023 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.466023 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:58.466023 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.466023 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.467333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.467937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:58.487297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:58.488486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:58.488882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:58.489203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.490190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:19:58.490190 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.490190 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:58.490190 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.490190 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.490190 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:58.490190 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.490190 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:58.491467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.491985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:58.492762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:58.493118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:19:58.493436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:58.493638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.494311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:19:58.494311 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.494311 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:58.494311 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.494311 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.494311 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:58.494311 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.494311 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:58.495735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.496185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:19:58.497236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.497806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.498313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:58.498313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.498313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:58.759947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:58.760211 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:58.760820 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:58.761156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.762207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:58.762207 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.762207 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:58.762207 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.762207 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.762207 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:58.762207 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.762207 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:19:58.763072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.764127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:58.764971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.766120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:19:58.800838 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:19:58.801266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:19:58.801762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:58.802060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:19:58.802189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.802753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:19:58.802753 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.802753 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:19:58.802753 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.802753 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.802753 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:19:58.802753 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.802753 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.803866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:19:58.804658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:03.421936 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:03.423398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:03.456645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:03.456808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.457443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:03.457443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.457443 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:03.457443 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.457443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.457443 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:03.457443 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.457443 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.458250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.459479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:03.487781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:03.488818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:03.489000 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:03.489146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.489869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:03.489869 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.489869 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:03.489869 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.489869 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.489869 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:03.489869 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.489869 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:03.491433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.492296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:03.493129 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:03.493578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:03.493786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:03.494088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.494937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:03.494937 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.494937 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:03.494937 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.494937 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.494937 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:03.494937 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.494937 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:03.495853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.496515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:03.496769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.497172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.497607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:03.497607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.497607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:03.760451 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:03.760964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:03.762126 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:03.762479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.763490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:03.763490 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.763490 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:03.763490 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.763490 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.763490 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:03.763490 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.763490 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:03.764524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:03.764852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:03.764852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.764852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:03.764852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.764852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.764852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:03.764852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.764852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:03.766145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.766857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:03.767196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.767196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:03.801306 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:03.802007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:03.802213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:03.802580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:03.802791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.803904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:03.803904 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.803904 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:03.803904 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.803904 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.803904 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:03.803904 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.803904 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.805446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:03.806805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:08.422645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:08.424241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:08.460635 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:08.461110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.461990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:08.461990 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.461990 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:08.461990 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.461990 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.461990 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:08.461990 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.461990 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.463251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.463949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:08.488338 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:08.489271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:08.489541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:08.489781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.490633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:08.490633 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.490633 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:08.490633 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.490633 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.490633 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:08.490633 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.490633 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:08.492039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.492905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:08.493802 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:08.493887 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:08.494209 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:08.494347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.494912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:08.494912 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.494912 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:08.494912 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.494912 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.494912 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:08.494912 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.494912 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:08.495832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.496339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:08.496850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.497356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.497852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:08.497852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.497852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:08.761233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:08.761644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:08.762438 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:08.762914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.763768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:08.763768 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.763768 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:08.763768 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.763768 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.763768 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:08.763768 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.763768 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:08.764326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:08.764804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:08.764804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.764804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:08.764804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.764804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.764804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:08.764804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.764804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:08.765124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.765647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:08.769053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.769053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:08.802064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:08.802579 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:08.803151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:08.803437 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:08.803630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:08.804170 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.804170 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:08.804170 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.804170 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.804170 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:08.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.805385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:08.806193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:13.423239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:13.424840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:13.431776 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=237 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:20:13.459991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:13.460644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.462105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:13.462105 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.462105 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:13.462105 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.462105 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.462105 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:13.462105 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.462105 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.464093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.464803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:13.489082 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:13.490161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:13.490551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:13.490700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.491519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:13.491519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.491519 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:13.491519 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.491519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.491519 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:13.491519 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.491519 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:13.493233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.493749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:13.494389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:13.494863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:13.495828 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:13.496037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.496781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:13.496781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.496781 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:13.496781 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.496781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.496781 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:13.496781 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.496781 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:13.498027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.498442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:13.499101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.499709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.500387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:13.500387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.500387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:13.761827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:13.762372 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:13.763446 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:13.763752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.764638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:13.764638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.764638 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:13.764638 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.764638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.764638 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:13.764638 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.764638 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:13.765966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:13.766394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:13.766394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.766394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:13.766394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.766394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.766394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:13.766394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.766394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:13.767681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.768108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:13.768586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.768586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:13.802578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:13.803041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:13.803434 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:13.803798 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:13.804011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.804671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:13.804671 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.804671 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:13.804671 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.804671 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.804671 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:13.804671 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.804671 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.805995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:13.806479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:18.423816 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:18.424842 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:18.457152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:18.457667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.458457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:18.458457 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.458457 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:18.458457 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.458457 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.458457 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:18.458457 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.458457 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.459720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.460596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:18.489486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:18.490528 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:18.490807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:18.491101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.491823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:18.491823 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.491823 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:18.491823 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.491823 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.491823 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:18.491823 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.491823 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:18.493018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.493635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:18.494460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:18.494944 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:18.495492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:18.495736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.496243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:18.496243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.496243 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:18.496243 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.496243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.496243 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:18.496243 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.496243 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:18.501938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:18.502426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.502904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.503416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:18.762473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:18.763114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:18.763635 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:18.763941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.764605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:18.764605 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.764605 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:18.764605 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.764605 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.764605 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:18.764605 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.764605 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:18.766050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:18.766810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:18.766810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.766810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:18.766810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.766810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.766810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:18.766810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.766810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:18.768036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.768840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:18.769790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.769790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:18.803085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:18.803558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:18.804423 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:18.805037 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:18.805405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.806587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:18.806587 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.806587 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:18.806587 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.806587 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.806587 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:18.806587 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.806587 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.808263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:18.809085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:23.316701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:23.352057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 08 13:20:23.352057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, security_groups=2, routers=1, router_ports=1 {{(pid=104932) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 08 13:20:23.352057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:20:23.384478 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, resource={'id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'name': 'private', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['b9c480ba-80ab-475b-b935-84420037c6ca', 'd4905e6d-9f85-4996-afec-3692c12d93d1'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:10:08Z', 'updated_at': '2026-04-08T13:10:12Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21658}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.385164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.385346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c9a391e0-7fa7-4719-b96c-81fc2e60a06f, external_ids_update=None, columns={'tag': 21658}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.385475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.386166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:20:23.386166 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.386166 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.386166 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.386166 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.386166 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.386166 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.386166 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.387085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.387673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.388321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:20:23.388321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.388321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:20:23.388321 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:20:23.414772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, resource={'id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'name': 'public', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['88cc7e33-1b68-4e35-9edc-36247de507c0', 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-08T13:10:14Z', 'updated_at': '2026-04-08T13:10:22Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.415161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.415854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-83258353-9720-4502-8be2-b82538bb4ee2, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.416100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.417009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:20:23.417009 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.417009 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.417009 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.417009 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.417009 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.417009 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.417009 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.417861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.418491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.419190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:20:23.419190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.419190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:20:23.419190 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:20:23.425940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:23.429398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:23.483825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, resource={'id': 'a5d505fb-12e2-4aed-8078-02b88b929c5e', 'name': 'admin_net', 'tenant_id': '98be377457d344c7834b290dc92d0dda', 'project_id': '98be377457d344c7834b290dc92d0dda', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['39438f35-bd24-4a86-8cab-99f980e8887d'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:05Z', 'updated_at': '2026-04-08T13:14:07Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 13489}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.484452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.486330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-daf5372b-8660-44b8-b300-e46a7451059b, external_ids_update=None, columns={'tag': 13489}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.486498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:20:23.489091 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.489091 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.489091 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.489091 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.489091 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.489091 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.493952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.494365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.494873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:20:23.494873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.494873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:20:23.496012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:23.497962 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:20:23.498784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:23.499325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.499593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.499825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.501067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:23.501067 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.501067 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.501067 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.501067 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.501067 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.501067 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.501067 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.503500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.504002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:23.504585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:23.508483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.508796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.509457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:23.509457 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.509457 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.509457 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.509457 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.509457 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.509457 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.509457 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.512011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.512521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:23.513419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.513697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.514398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:20:23.514398 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.514398 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.514398 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.514398 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.514398 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.514398 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.514398 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:23.516781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.517281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:23.520372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.521085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.521803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:23.521803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.521803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:23.545608 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-daec8bf3-7182-4be9-bfe4-655236471090, resource={'id': 'daec8bf3-7182-4be9-bfe4-655236471090', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['28da0a33-78ce-48f8-89df-3533da3ec3de'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:49Z', 'updated_at': '2026-04-08T13:14:49Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 54317}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.545946 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-daec8bf3-7182-4be9-bfe4-655236471090, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.546341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-4b03e103-5c09-4760-adf8-c6bbd598718a, external_ids_update=None, columns={'tag': 54317}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.546511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.547197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:20:23.547197 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.547197 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.547197 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.547197 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.547197 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.547197 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.547197 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.548373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.548715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.549084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:20:23.549084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.549084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:20:23.549084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource d9026daf-f4c9-405c-9bae-72ce3e878e44 (type: security_groups) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:20:23.583736 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.db.ovn_revision_numbers_db [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Successfully bumped revision number for resource d9026daf-f4c9-405c-9bae-72ce3e878e44 (type: security_groups) to 10
Apr 08 13:20:23.583854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource c6de2885-4927-41ad-b36d-b83c360e1dcd (type: security_groups) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:20:23.627266 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.db.ovn_revision_numbers_db [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Successfully bumped revision number for resource c6de2885-4927-41ad-b36d-b83c360e1dcd (type: security_groups) to 15
Apr 08 13:20:23.627410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:20:23.721705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, resource={'id': '71709845-924e-42fd-985e-d000e2c61286', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'enable_snat': True}, 'gw_port_id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-az3g9', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'ip_address': '172.24.5.223', 'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'}, {'ip_address': '2001:db8::19', 'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 3, 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985'}, resource_type=routers, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.722029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.722149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.723239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.723352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.724078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:20:23.724078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.724078 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.724078 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.724078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.724078 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.724078 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.724078 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.724522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Unable to update router 71709845-924e-42fd-985e-d000e2c61286. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 08 13:20:23.725587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:20:23.726394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:20:23.727124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Fixing resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:20:23.763951 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:23.764941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:23.765720 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.766727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.768163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:23.768163 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.768163 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.768163 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.768163 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.768163 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.768163 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.768163 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:23.770373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.771111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:23.771111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.771111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:23.771111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.771111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.771111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:23.771111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.771111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:23.774635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.775337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:23.776309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.776309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:23.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:23.805129 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:23.805637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.805880 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.806035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.814264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:23.814264 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.814264 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.814264 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.814264 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.814264 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.814264 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.814264 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.818271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.819071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:23.860019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, resource={'id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'name': '', 'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'project_id': '', 'mac_address': 'fa:16:3e:d4:5c:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71709845-924e-42fd-985e-d000e2c61286', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164309', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.860377 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5 88cc7e33-1b68-4e35-9edc-36247de507c0', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-71709845-924e-42fd-985e-d000e2c61286'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.223/24', '2001:db8::19/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.860908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=59fc94c5-b567-475a-b3a9-f77ef27251c0, lrouter_port=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:23.861263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.862077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:20:23.862077 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.862077 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:23.862077 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.862077 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.862077 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:23.862077 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.862077 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Failed to fix resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.862955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:20:23.863510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:23.864124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:20:23.864124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:23.864124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:20:23.864124 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Maintenance task: Synchronization completed (took 0.51 seconds)
Apr 08 13:20:28.427646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:28.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:28.461589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:28.462090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.462933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:28.462933 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.462933 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:28.462933 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.462933 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.462933 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:28.462933 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.462933 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.478287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.479656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:28.496940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:28.498768 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:28.499104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:28.499391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.500369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:28.500369 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.500369 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:28.500369 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.500369 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.500369 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:28.500369 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.500369 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:28.502123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.502919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:28.503722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:28.503722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:28.504119 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:28.504373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.505808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:28.505808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.505808 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:28.505808 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.505808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.505808 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:28.505808 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.505808 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:28.507161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.507743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:28.508725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.509171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.509688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:28.509688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.509688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:28.765180 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:28.765703 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:28.766215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:28.766484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.767211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:28.767211 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.767211 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:28.767211 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.767211 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.767211 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:28.767211 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.767211 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:28.768775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:28.769413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:28.769413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.769413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:28.769413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.769413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.769413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:28.769413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.769413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:28.769776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.770573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:28.771304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.771304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:28.805196 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:28.805789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:28.806420 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:28.806773 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:28.806970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.807756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:28.807756 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.807756 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:28.807756 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.807756 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.807756 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:28.807756 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.807756 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.809578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:28.810188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:33.428220 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:33.429882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:33.468027 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:33.468292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.469596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:33.469596 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.469596 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:33.469596 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.469596 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.469596 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:33.469596 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.469596 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.471401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.471894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:33.497390 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.500250 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:33.501718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.502684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:33.503533 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:33.504067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:33.504398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:33.504576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.505130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:33.505130 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.505130 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:33.505130 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.505130 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.505130 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:33.505130 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.505130 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:33.506406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.507231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:33.508040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.508488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.508973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:33.508973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.508973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:33.765744 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:33.766263 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:33.766947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:33.767227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.767834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:33.767834 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.767834 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:33.767834 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.767834 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.767834 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:33.767834 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.767834 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:33.769335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:33.770045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:33.770045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.770045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:33.770045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.770045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.770045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:33.770045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.770045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:33.771000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.773075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:33.774369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.774369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:33.805549 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:33.806150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:33.806930 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:33.807330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:33.807553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.808584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:33.808584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.808584 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:33.808584 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.808584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.808584 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:33.808584 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.808584 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.810506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:33.811256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:38.429166 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:38.430587 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:38.467687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:38.467911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.468395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:38.468395 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.468395 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:38.468395 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.468395 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.468395 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:38.468395 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.468395 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.469561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.469962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:38.498061 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:38.499236 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:38.499507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:38.499812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.500629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:38.500629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.500629 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:38.500629 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.500629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.500629 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:38.500629 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.500629 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:38.502324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.502897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:38.503868 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:38.504369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:38.504925 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:38.505244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.506233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:38.506233 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.506233 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:38.506233 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.506233 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.506233 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:38.506233 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.506233 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:38.507344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.507878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:38.508610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.509195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.509713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:38.509713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.509713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:38.766344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:38.766829 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:38.768025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:38.768653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.769683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:38.769683 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.769683 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:38.769683 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.769683 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.769683 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:38.769683 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.769683 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:38.770538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:38.771238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:38.771238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.771238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:38.771238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.771238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.771238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:38.771238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.771238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:38.771671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.772309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:38.773373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.773373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:38.806523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:38.807388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:38.808132 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:38.808655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:38.808957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.810777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:38.810777 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.810777 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:38.810777 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.810777 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.810777 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:38.810777 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.810777 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.812354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:38.813282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:43.430376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:43.431643 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:43.472520 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:43.472966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.473986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:43.473986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.473986 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:43.473986 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.473986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.473986 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:43.473986 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.473986 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.474890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.475410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:43.498645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:43.502586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:43.502777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:43.503041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:43.504509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:43.505188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:43.505861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:43.506164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.506555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:43.506555 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.506555 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:43.506555 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.506555 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.506555 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:43.506555 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.506555 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:43.507864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.508922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:43.509475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.509988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.510526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:43.510526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.510526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:43.767073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:43.767706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:43.768485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:43.768925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.769788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:43.769788 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.769788 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:43.769788 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.769788 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.769788 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:43.769788 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.769788 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:43.771199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:43.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:43.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:43.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:43.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.771948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:43.773015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.773730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:43.774538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.774538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:43.807152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:43.807594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:43.808146 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:43.808486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:43.808753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.809560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:43.809560 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.809560 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:43.809560 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.809560 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.809560 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:43.809560 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.809560 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.811413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:43.812409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:48.430829 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:48.431879 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:48.469065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:48.469360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.470207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:48.470207 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.470207 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:48.470207 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.470207 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.470207 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:48.470207 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.470207 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.471438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.472249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:48.499293 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:48.500654 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:48.501032 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:48.501346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.502420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:48.502420 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.502420 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:48.502420 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.502420 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.502420 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:48.502420 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.502420 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:48.503602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.504367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:48.505439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:48.505913 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:48.506511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:48.506777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.507390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:48.507390 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.507390 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:48.507390 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.507390 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.507390 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:48.507390 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.507390 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:48.508726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.509183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:48.510484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.510963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.511413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:48.511413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.511413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:48.767779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:48.768341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:48.769171 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:48.769645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.770587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:48.770587 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.770587 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:48.770587 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.770587 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.770587 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:48.770587 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.770587 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:48.771982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:48.773081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:48.773081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.773081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:48.773081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.773081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.773081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:48.773081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.773081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:48.773987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.775040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:48.776199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.776199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:48.807700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:48.808215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:48.808969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:48.809376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:48.809639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.810394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:48.810394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.810394 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:48.810394 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.810394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.810394 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:48.810394 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.810394 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.812243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:48.813305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:53.431268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:53.432507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:53.463804 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:53.464039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.464700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:53.464700 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.464700 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:53.464700 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.464700 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.464700 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:53.464700 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.464700 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.465948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.466689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:53.499966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:53.501133 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:53.502128 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:53.502128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.503116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:53.503116 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.503116 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:53.503116 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.503116 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.503116 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:53.503116 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.503116 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:53.505377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.506208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:53.507271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:53.507271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:53.507271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:53.507271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.508217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:53.508217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.508217 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:53.508217 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.508217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.508217 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:53.508217 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.508217 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:53.509585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.510446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:53.511430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.512316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.513374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:53.513374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.513374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:53.769195 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:53.769752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:53.769922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:53.770158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.770606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:53.770606 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.770606 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:53.770606 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.770606 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.770606 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:53.770606 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.770606 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:53.771418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:53.772148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:53.772148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.772148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:53.772148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.772148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.772148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:53.772148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.772148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:53.772493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.773261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:53.774129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.774129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:53.808245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:53.808644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:53.809119 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:53.809466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:53.809760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.810834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:53.810834 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.810834 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:53.810834 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.810834 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.810834 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:53.810834 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.810834 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.812737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:53.813448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:58.432163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:58.433838 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:58.500665 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:58.502782 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:58.502977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:58.503070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.506086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:20:58.506086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.506086 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:58.506086 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.506086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.506086 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:58.506086 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.506086 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:58.508274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.508972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:58.510161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:58.510645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:20:58.511510 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:58.511734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.512499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:20:58.512499 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.512499 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:58.512499 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.512499 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.512499 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:58.512499 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.512499 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:58.513885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.515358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.515980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:58.517538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:58.518465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:58.519441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.520582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:58.520582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.520582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.520582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:58.520582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.520582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:58.769865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:58.770359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:58.771175 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:58.771586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.772415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:58.772415 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.772415 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:58.772415 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.772415 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.772415 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:58.772415 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.772415 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:20:58.773891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:58.774946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:20:58.774946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.774946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:20:58.774946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.774946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.774946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:20:58.774946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.774946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:20:58.775601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.776132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:58.776612 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.776612 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:20:58.808881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:20:58.809489 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:20:58.809745 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:58.809938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:20:58.810080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.810810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:20:58.810810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.810810 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:20:58.810810 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.810810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.810810 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:20:58.810810 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.810810 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.812382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:20:58.812857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:03.433148 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:03.434855 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:03.481174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:03.481174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.481473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:21:03.481473 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.481473 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:03.481473 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.481473 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.481473 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:03.481473 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.481473 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.483382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.484251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:03.501323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:03.503588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:03.503588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:03.503588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.503886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:21:03.503886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.503886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:03.503886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.503886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.503886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:03.503886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.503886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:03.505249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.506074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:03.510562 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:03.511104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:03.511660 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:03.511809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.512496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:21:03.512496 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.512496 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:03.512496 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.512496 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.512496 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:03.512496 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.512496 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:03.513985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.514412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:03.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.516534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.517556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:03.517556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.517556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:03.770404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:03.770753 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:03.771041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:03.771321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.771932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:03.771932 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.771932 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:03.771932 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.771932 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.771932 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:03.771932 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.771932 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:03.773149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:03.774160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:03.774160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.774160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:03.774160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.774160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.774160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:03.774160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.774160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:03.775206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.776370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:03.777392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.777392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:03.809545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:03.810242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:03.811149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:03.811513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:03.811821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.812704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:03.812704 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.812704 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:03.812704 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.812704 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.812704 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:03.812704 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.812704 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.814756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:03.815833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:08.434089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:08.435898 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:08.470418 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:08.470865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.471538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:21:08.471538 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.471538 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:08.471538 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.471538 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.471538 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:08.471538 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.471538 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.472444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.472950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:08.501881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:08.503818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:08.503818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:08.503818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.504258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:21:08.504258 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.504258 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:08.504258 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.504258 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.504258 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:08.504258 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.504258 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:08.505312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.506372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:08.511025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:08.511909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:08.512416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:08.512642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.513267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:21:08.513267 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.513267 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:08.513267 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.513267 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.513267 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:08.513267 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.513267 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:08.514859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.515428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:08.516496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.517112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.517854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:08.517854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.517854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:08.771064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:08.771468 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:08.772084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:08.772467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.773212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:08.773212 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.773212 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:08.773212 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.773212 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.773212 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:08.773212 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.773212 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:08.774406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:08.775253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:08.775253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.775253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:08.775253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.775253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.775253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:08.775253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.775253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:08.776041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.776889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:08.777767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.777767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:08.810130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:08.810813 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:08.811373 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:08.811870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:08.812148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.812952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:08.812952 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.812952 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:08.812952 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.812952 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.812952 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:08.812952 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.812952 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.814732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:08.815500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:13.434863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:13.436676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:13.438758 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=470,neutron:UPDATE=2 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:21:13.474362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:13.474838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.475841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:21:13.475841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.475841 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:13.475841 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.475841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.475841 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:13.475841 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.475841 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.477042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.478005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:13.502661 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:13.503781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:13.504215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:13.504524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.505774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:21:13.505774 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.505774 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:13.505774 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.505774 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.505774 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:13.505774 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.505774 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:13.507418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.508267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:13.511641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:13.512557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:13.513075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:13.513240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.513805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:21:13.513805 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.513805 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:13.513805 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.513805 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.513805 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:13.513805 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.513805 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:13.514598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.515055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:13.515837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.516289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.517030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:13.517030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.517030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:13.771796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:13.772182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:13.773087 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:13.773497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.774378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:13.774378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.774378 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:13.774378 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.774378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.774378 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:13.774378 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.774378 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:13.775908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:13.776516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:13.776516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.776516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:13.776516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.776516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.776516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:13.776516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.776516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:13.777819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.778276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:13.778779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.778779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:13.810698 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:13.811573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:13.812115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:13.812556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:13.813094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.813895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:13.813895 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.813895 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:13.813895 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.813895 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.813895 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:13.813895 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.813895 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.815020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:13.815956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:18.435653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:18.450390 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:18.484877 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:18.485290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.486127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:21:18.486127 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.486127 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:18.486127 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.486127 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.486127 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:18.486127 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.486127 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.486964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.487467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:18.503652 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:18.512138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:18.513238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:18.513488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:18.513794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.514553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:21:18.514553 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.514553 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:18.514553 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.514553 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.514553 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:18.514553 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.514553 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:18.516363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.516841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:18.517298 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:18.517298 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:18.517424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.518234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:21:18.518234 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.518234 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:18.518234 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.518234 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.518234 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:18.518234 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.518234 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:18.519442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.520096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:18.521301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.522085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.522929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:18.522929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.522929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:18.772364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:18.772858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:18.773440 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:18.773675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.774201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:18.774201 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.774201 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:18.774201 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.774201 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.774201 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:18.774201 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.774201 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:18.775053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:18.775672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:18.775672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.775672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:18.775672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.775672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.775672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:18.775672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.775672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:18.776124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.776428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:18.776793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.776793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:18.812077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:18.812302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:18.812883 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:18.813329 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:18.813586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.814183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:18.814183 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.814183 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:18.814183 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.814183 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.814183 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:18.814183 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.814183 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.815148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:18.815964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:23.449041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:23.450318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:23.543394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:23.543536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:23.544922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:23.545924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:23.545924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:23.546581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.547795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Traceback (most recent call last):
Apr 08 13:21:23.547795 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.547795 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:23.547795 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.547795 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.547795 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:23.547795 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.547795 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4f1e83e5-f77e-43a6-896b-dc5bebd4d5da None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:23.548921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.549316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:23.552367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:23.554820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.555361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:21:23.555361 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.555361 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:23.555361 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.555361 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.555361 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:23.555361 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.555361 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:23.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.561655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:23.563317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.563783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.564540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:23.564540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.564540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:23.565784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:23.567013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.567130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Traceback (most recent call last):
Apr 08 13:21:23.567130 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.567130 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:23.567130 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.567130 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.567130 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:23.567130 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.567130 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8df4c26f-da2d-404a-9793-d940e28dfe84 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.568330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.569145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:23.772942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:23.773361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:23.775336 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:23.775336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.775514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:23.775514 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.775514 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:23.775514 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.775514 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.775514 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:23.775514 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.775514 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:23.776940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:23.777932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:23.777932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.777932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:23.777932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.777932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.777932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:23.777932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.777932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:23.778600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.779359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:23.780308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.780308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:23.812245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:23.812696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:23.814443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:23.814443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:23.814443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.814704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:23.814704 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.814704 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:23.814704 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.814704 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.814704 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:23.814704 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.814704 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.815445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:23.816178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:28.449992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:28.451360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:28.489043 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:28.489043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.489353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:21:28.489353 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.489353 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:28.489353 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.489353 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.489353 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:28.489353 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.489353 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.490187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.491114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:28.544083 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:28.544984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:28.545397 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:28.547001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:28.547001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:28.547001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.548993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:21:28.548993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.548993 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:28.548993 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.548993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.548993 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:28.548993 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.548993 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:28.550732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.552974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.553603 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:28.553960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:28.554379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:28.554379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.554379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:28.554379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.554379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.554379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:28.554379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.554379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:28.556918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.557816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.558854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:28.558854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.558854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:28.773750 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:28.774305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:28.776300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:28.776300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.776565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:28.776565 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.776565 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:28.776565 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.776565 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.776565 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:28.776565 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.776565 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:28.777820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:28.778702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:28.778702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.778702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:28.778702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.778702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.778702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:28.778702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.778702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:28.779552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.780163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:28.780890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.780890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:28.812847 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:28.813408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:28.815294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:28.815294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:28.815294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.815670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:28.815670 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.815670 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:28.815670 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.815670 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.815670 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:28.815670 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.815670 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.817177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:28.818683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:33.450546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:33.451568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:33.483241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:33.483704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.484571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:21:33.484571 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.484571 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:33.484571 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.484571 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.484571 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:33.484571 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.484571 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.485563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.486476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:33.547722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:33.547722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:33.547722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:33.548112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:33.548447 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:33.549091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.550877 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:33.551157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.552022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:21:33.552022 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.552022 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:33.552022 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.552022 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.552022 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:33.552022 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.552022 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:33.554051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.554698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:33.557335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:33.557335 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.557335 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:33.557335 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.557335 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.557335 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:33.557335 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.557335 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:33.558275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.558830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.559422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:33.559422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.559422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.563469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.563982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:33.774518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:33.774801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:33.775237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:33.775528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.775972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:33.775972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.775972 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:33.775972 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.775972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.775972 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:33.775972 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.775972 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:33.776670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.777554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:33.778375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.779326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:33.813749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:33.814126 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:33.814741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:33.814995 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:33.815156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.817728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:33.817728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.817728 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:33.817728 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.817728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.817728 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:33.817728 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.817728 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.819031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:33.819706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:38.451329 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:38.453435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:38.489367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:38.489780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.490595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:21:38.490595 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.490595 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:38.490595 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.490595 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.490595 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:38.490595 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.490595 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.492109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.492607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:38.546145 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:38.546397 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:38.547838 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:38.548424 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:38.548666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:38.548833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.549774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Traceback (most recent call last):
Apr 08 13:21:38.549774 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.549774 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:38.549774 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.549774 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.549774 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:38.549774 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.549774 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:38.550254 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:38.551719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.552447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.553223 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:38.553628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.554297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:38.555233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.556094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.557304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:38.557304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.557304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:38.774935 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:38.775391 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:38.776215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:38.776809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.778560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:38.778560 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.778560 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:38.778560 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.778560 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.778560 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:38.778560 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.778560 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:38.779693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:38.780189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:38.780189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.780189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:38.780189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.780189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.780189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:38.780189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.780189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:38.781097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.781444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:38.781823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.781823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:38.814062 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:38.814788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:38.815443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:38.815867 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:38.816101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.816913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:38.816913 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.816913 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:38.816913 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.816913 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.816913 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:38.816913 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.816913 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.818674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:38.819005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:43.452012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:43.453173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:43.489426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:43.489810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.490823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:21:43.490823 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.490823 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:43.490823 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.490823 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.490823 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:43.490823 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.490823 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.493056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.493565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:43.547048 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:43.547633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:43.547976 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:43.548213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:43.548345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.549251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:43.549879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Traceback (most recent call last):
Apr 08 13:21:43.549879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.549879 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:43.549879 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.549879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.549879 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:43.549879 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.549879 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:43.551400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.552002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.553203 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:43.554309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:43.554990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:43.554990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.554990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:43.554990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.554990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.554990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:43.554990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.554990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:43.555719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.556335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.557001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:43.557001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.557001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:43.775681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:43.776068 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:43.777068 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:43.777477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.778079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:43.778079 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.778079 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:43.778079 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.778079 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.778079 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:43.778079 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.778079 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:43.778742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.779476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:43.780221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.781416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:43.814767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:43.815176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:43.815938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:43.816463 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:43.817068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.818044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:43.818044 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.818044 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:43.818044 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.818044 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.818044 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:43.818044 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.818044 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.819227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:43.819738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:48.462165 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:48.463252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:48.498683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:48.499042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.500022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:21:48.500022 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.500022 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:48.500022 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.500022 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.500022 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:48.500022 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.500022 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.502002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.503171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:48.547724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:48.549153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:48.549693 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:48.550426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:48.550740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:48.550936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.551931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:21:48.551931 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.551931 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:48.551931 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.551931 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.551931 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:48.551931 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.551931 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:48.553816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.554156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:48.554541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:48.554541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.555349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Traceback (most recent call last):
Apr 08 13:21:48.555349 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.555349 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:48.555349 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.555349 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.555349 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:48.555349 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.555349 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:48.556123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:48.557112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.557991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.558941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:48.776191 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:48.776458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:48.777261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:48.777657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.778364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:48.778364 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.778364 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:48.778364 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.778364 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.778364 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:48.778364 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.778364 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:48.779084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:48.781072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:48.781072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.781072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:48.781072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.781072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.781072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:48.781072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.781072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:48.781691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.782173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:48.782721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.782721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:48.815221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:48.815859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:48.816435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:48.816846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:48.817065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.817822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:48.817822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.817822 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:48.817822 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.817822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.817822 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:48.817822 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.817822 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.819895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:48.821004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:53.462942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:53.464908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:53.495048 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:53.495304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.496102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:21:53.496102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.496102 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:53.496102 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.496102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.496102 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:53.496102 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.496102 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.496959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.498054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:53.548295 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:53.549327 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:53.549728 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:53.550193 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:53.550801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.552347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:53.553063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:21:53.553063 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.553063 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:53.553063 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.553063 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.553063 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:53.553063 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.553063 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:53.553455 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:53.555603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.556439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Traceback (most recent call last):
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.557331 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:53.557850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.558540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-e8c446b2-cd44-4cec-9766-3f7a03fc54e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:53.559347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.560232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.561059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:53.561059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.561059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:53.776911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:53.777342 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:53.777965 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:53.778148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.778851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:53.778851 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.778851 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:53.778851 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.778851 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.778851 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:53.778851 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.778851 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:53.780174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:53.780881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:53.780881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.780881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:53.780881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.780881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.780881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:53.780881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.780881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:53.781759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.782434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:53.783271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.783271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:53.815723 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:53.816137 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:53.816543 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:53.816748 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:53.816888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.817415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:53.817415 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.817415 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:53.817415 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.817415 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.817415 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:53.817415 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.817415 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.819154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:53.820061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:58.463465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:58.465483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:58.534648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:58.534834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.535434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:21:58.535434 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.535434 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:58.535434 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.535434 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.535434 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:58.535434 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.535434 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.536641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.537183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:58.548731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:58.549338 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:58.549519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:58.549641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.550102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:58.550102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.550102 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:58.550102 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.550102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.550102 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:58.550102 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.550102 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.551974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.552811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.553659 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:58.554895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:58.555763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:58.555763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.555763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:58.555763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.555763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.555763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:58.555763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.555763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:21:58.556646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.557439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.558333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:58.558333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.558333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:58.777674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:58.778135 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:58.778628 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:58.778822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.779360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:58.779360 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.779360 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:58.779360 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.779360 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.779360 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:58.779360 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.779360 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:21:58.780324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:58.780789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:21:58.780789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.780789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:21:58.780789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.780789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.780789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:21:58.780789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.780789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:21:58.781471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.781970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:58.782452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.782452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:21:58.816284 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:21:58.816696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:21:58.817169 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:58.817544 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:21:58.817874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.818986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:21:58.818986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.818986 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:21:58.818986 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.818986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.818986 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:21:58.818986 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.818986 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.820869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:21:58.821834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:03.464239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:03.465881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:03.509926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:03.511776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.512016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:03.512016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.512016 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:03.512016 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.512016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.512016 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:03.512016 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.512016 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.512923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.514802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:03.551048 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:03.552790 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:03.552790 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:03.552790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.553135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:03.553135 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.553135 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:03.553135 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.553135 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.553135 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:03.553135 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.553135 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.555334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.555929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:03.556976 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:03.557296 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:03.557924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:03.558752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.558981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:03.558981 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.558981 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:03.558981 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.558981 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.558981 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:03.558981 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.558981 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:03.560249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:03.560798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:03.560798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.560798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:03.560798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.560798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.560798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:03.560798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.560798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:03.562803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.563305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.564079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:03.564079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.564079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:03.778720 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:03.778720 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:03.779784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:03.780894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.781327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:03.781327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.781327 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:03.781327 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.781327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.781327 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:03.781327 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.781327 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:03.782274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.782837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:03.783267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.783784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:03.817171 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:03.817461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:03.817771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:03.817966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:03.818770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.819522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:03.819522 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.819522 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:03.819522 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.819522 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.819522 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:03.819522 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.819522 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.820570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:03.821464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:08.464828 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:08.466013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:08.496145 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:08.496679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.497660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:08.497660 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.497660 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:08.497660 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.497660 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.497660 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:08.497660 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.497660 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.498536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.499773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:08.551661 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:08.552524 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:08.552778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:08.552904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.553644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:08.553644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.553644 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:08.553644 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.553644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.553644 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:08.553644 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.553644 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.554753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.555459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:08.557309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:08.557558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:08.558037 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:08.558564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.561286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:08.561286 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.561286 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:08.561286 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.561286 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.561286 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:08.561286 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.561286 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:08.564932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:08.565692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:08.565692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.565692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:08.565692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.565692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.565692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:08.565692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.565692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:08.565941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.566405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.566939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:08.566939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.566939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:08.778986 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:08.779452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:08.780225 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:08.780640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.782124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:08.782124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.782124 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:08.782124 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.782124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.782124 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:08.782124 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.782124 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:08.783582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:08.784334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:08.784334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.784334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:08.784334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.784334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.784334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:08.784334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.784334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:08.785468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.785992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:08.786448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.786448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:08.817749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:08.818511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:08.818952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:08.819289 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:08.819510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.820328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:08.820328 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.820328 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:08.820328 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.820328 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.820328 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:08.820328 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.820328 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.822307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:08.823229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:13.465471 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:13.467484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:13.469446 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:22:13.507990 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:13.508171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.508819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:13.508819 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.508819 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:13.508819 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.508819 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.508819 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:13.508819 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.508819 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.509692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.510449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:13.552184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:13.553166 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:13.553369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:13.553508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.554209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:13.554209 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.554209 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:13.554209 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.554209 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.554209 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:13.554209 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.554209 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.555384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.555901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:13.557736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:13.558398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:13.558951 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:13.559312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.560156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Traceback (most recent call last):
Apr 08 13:22:13.560156 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.560156 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:13.560156 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.560156 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.560156 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:13.560156 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.560156 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:13.561449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.561909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:13.563164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.563727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.564377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:13.564377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.564377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:13.779658 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:13.780095 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:13.780549 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:13.780869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.781518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:13.781518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.781518 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:13.781518 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.781518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.781518 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:13.781518 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.781518 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:13.783497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:13.784254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:13.784254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.784254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:13.784254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.784254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.784254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:13.784254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.784254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:13.785688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.786464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:13.787335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.787335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:13.818511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:13.818990 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:13.819390 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:13.819679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:13.819830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.820414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:13.820414 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.820414 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:13.820414 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.820414 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.820414 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:13.820414 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.820414 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.821523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:13.822195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:18.466366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:18.467348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:18.500190 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:18.500526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.501221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:18.501221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.501221 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:18.501221 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.501221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.501221 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:18.501221 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.501221 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.502379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.503099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:18.552891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:18.553928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:18.554230 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:18.554506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.555357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:18.555357 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.555357 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:18.555357 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.555357 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.555357 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:18.555357 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.555357 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.556975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.557814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:18.558648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:18.558648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:18.559133 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:18.559406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.560236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Traceback (most recent call last):
Apr 08 13:22:18.560236 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.560236 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:18.560236 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.560236 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.560236 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:18.560236 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.560236 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:18.561647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.562479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:18.563813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.564686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.565609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:18.565609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.565609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:18.780296 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:18.780641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:18.781213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:18.781852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.782468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:18.782468 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.782468 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:18.782468 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.782468 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.782468 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:18.782468 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.782468 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:18.783542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:18.784065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:18.784065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.784065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:18.784065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.784065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.784065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:18.784065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.784065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:18.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.785162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:18.785668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.785668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:18.818956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:18.819540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:18.820216 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:18.820475 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:18.820628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.821221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:18.821221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.821221 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:18.821221 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.821221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.821221 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:18.821221 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.821221 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.822936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:18.823878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:23.467042 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:23.468262 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:23.503641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:23.503913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.504711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:23.504711 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.504711 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:23.504711 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.504711 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.504711 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:23.504711 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.504711 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.505645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.506558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:23.553558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:23.554804 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:23.555149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:23.555402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.556295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:23.556295 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.556295 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:23.556295 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.556295 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.556295 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:23.556295 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.556295 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.557281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.558064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:23.559104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:23.559104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.560356 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:23.561207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.561949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:23.562392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.563306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.564378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:23.564378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.564378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:23.780915 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:23.781259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:23.781817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:23.782163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.782905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:23.782905 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.782905 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:23.782905 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.782905 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.782905 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:23.782905 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.782905 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:23.784016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:23.784476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:23.784476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.784476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:23.784476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.784476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.784476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:23.784476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.784476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:23.785074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.785590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:23.786094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.786094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:23.819650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:23.819992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:23.820500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:23.821000 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:23.821244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.822143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:23.822143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.822143 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:23.822143 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.822143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.822143 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:23.822143 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.822143 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.823531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:23.824539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:28.467573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:28.469496 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:28.505173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:28.505859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.506416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:28.506416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.506416 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:28.506416 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.506416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.506416 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:28.506416 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.506416 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.507599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.508658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:28.554291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:28.555260 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:28.555732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:28.555997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.557280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:28.557280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.557280 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:28.557280 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.557280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.557280 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:28.557280 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.557280 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.558140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.559007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:28.560536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:28.560536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:28.560536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:28.561021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.561878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:22:28.561878 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.561878 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:28.561878 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.561878 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.561878 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:28.561878 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.561878 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:28.563226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:28.565108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.566108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.567091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:28.781541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:28.781947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:28.782427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:28.782640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.783322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:28.783322 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.783322 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:28.783322 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.783322 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.783322 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:28.783322 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.783322 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:28.785133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:28.785879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:28.785879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.785879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:28.785879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.785879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.785879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:28.785879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.785879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:28.786777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.787442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:28.788180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.788180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:28.820166 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:28.820680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:28.821145 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:28.821479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:28.821657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.822210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:28.822210 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.822210 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:28.822210 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.822210 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.822210 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:28.822210 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.822210 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.823429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:28.823945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:33.468252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:33.469568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:33.503731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:33.504224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.504593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:33.504593 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.504593 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:33.504593 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.504593 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.504593 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:33.504593 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.504593 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.505447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.506320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:33.554781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:33.555637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:33.555829 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:33.555982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.556543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:33.556543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.556543 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:33.556543 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.556543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.556543 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:33.556543 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.556543 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.558166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.559087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:33.559873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:33.559873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:33.560161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:33.560355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.560860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:22:33.560860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.560860 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:33.560860 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.560860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.560860 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:33.560860 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.560860 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:33.561632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.562404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:33.562882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.563671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.564752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:33.564752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.564752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:33.781948 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:33.782778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:33.783205 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:33.783454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.784746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:33.784746 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.784746 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:33.784746 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.784746 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.784746 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:33.784746 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.784746 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:33.785247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.786116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:33.787249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.788777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:33.820838 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:33.821140 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:33.822412 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:33.822412 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:33.822412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.822996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:33.822996 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.822996 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:33.822996 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.822996 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.822996 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:33.822996 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.822996 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.823939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:33.824717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:38.468897 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:38.470316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:38.508552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:38.509011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.510005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:38.510005 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.510005 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:38.510005 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.510005 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.510005 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:38.510005 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.510005 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.511237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.512153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:38.555523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:38.556678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:38.556911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:38.557077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.557771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:38.557771 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.557771 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:38.557771 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.557771 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.557771 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:38.557771 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.557771 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.558974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.559596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:38.560588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:38.561052 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:38.561429 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:38.561884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.562147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:22:38.562147 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.562147 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:38.562147 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.562147 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.562147 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:38.562147 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.562147 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:38.563473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.564367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:38.564792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.565395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.566248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:38.566248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.566248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:38.783071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:38.783454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:38.784127 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:38.784384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.784954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:38.784954 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.784954 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:38.784954 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.784954 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.784954 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:38.784954 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.784954 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:38.785807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:38.786525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:38.786525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.786525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:38.786525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.786525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.786525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:38.786525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.786525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:38.786999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.787746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:38.788517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.788517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:38.821238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:38.821599 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:38.822105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:38.822479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:38.822739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.823556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:38.823556 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.823556 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:38.823556 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.823556 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.823556 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:38.823556 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.823556 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.825078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:38.825844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:43.469343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:43.471676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:43.508684 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:43.509288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.510345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:43.510345 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.510345 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:43.510345 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.510345 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.510345 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:43.510345 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.510345 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.511836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.512740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:43.556230 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:43.557242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:43.557644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:43.557910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.558923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:43.558923 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.558923 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:43.558923 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.558923 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.558923 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:43.558923 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.558923 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.560503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.561656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:43.562688 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:43.562688 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:43.562688 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:43.562688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.563050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:22:43.563050 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.563050 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:43.563050 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.563050 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.563050 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:43.563050 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.563050 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:43.563837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.564449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:43.564823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.565478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.566116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:43.566116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.566116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:43.783680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:43.784108 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:43.784953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:43.785634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.786925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:43.786925 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.786925 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:43.786925 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.786925 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.786925 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:43.786925 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.786925 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:43.788295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:43.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:43.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:43.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:43.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.789233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:43.792014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.792790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:43.793650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.793650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:43.821845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:43.822411 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:43.823112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:43.823489 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:43.823763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.824548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:43.824548 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.824548 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:43.824548 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.824548 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.824548 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:43.824548 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.824548 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.825832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:43.826715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:48.470073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:48.471454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:48.505073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:48.505449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.506309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:48.506309 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.506309 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:48.506309 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.506309 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.506309 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:48.506309 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.506309 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.507227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.507779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:48.556645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:48.558178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:48.558359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:48.558577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.559089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:48.559089 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.559089 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:48.559089 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.559089 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.559089 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:48.559089 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.559089 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.560141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.560985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:48.561803 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:48.570838 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:48.571435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:48.571630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.572052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:22:48.572052 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.572052 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:48.572052 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.572052 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.572052 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:48.572052 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.572052 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:48.572653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.573336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:48.573815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.574505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.575193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:48.575193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.575193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:48.784490 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:48.784920 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:48.785798 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:48.786189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.786982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:48.786982 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.786982 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:48.786982 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.786982 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.786982 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:48.786982 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.786982 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:48.787842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:48.788660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:48.788660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.788660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:48.788660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.788660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.788660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:48.788660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.788660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:48.789039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.789767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:48.790563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.790563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:48.822479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:48.823087 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:48.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:48.824022 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:48.824318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.825150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:48.825150 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.825150 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:48.825150 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.825150 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.825150 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:48.825150 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.825150 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.827054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:48.828036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:53.470927 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:53.472125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:53.501967 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:53.502222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.502901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:53.502901 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.502901 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:53.502901 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.502901 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.502901 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:53.502901 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.502901 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.503773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.504607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:53.557744 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.571431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.572100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:53.572486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:53.572824 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:53.572824 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:53.572824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.573043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:53.573043 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.573043 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:53.573043 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.573043 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.573043 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:53.573043 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.573043 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:53.573954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:53.574361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:53.574361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.574361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:53.574361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.574361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.574361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:53.574361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.574361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:53.574979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.575366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.575852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:53.575852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.575852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:53.785111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:53.785456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:53.786067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.787012 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:53.788064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:53.788800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:53.788800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.788800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:53.788800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.788800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.788800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:53.788800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.788800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:53.789848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.790728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:53.791556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.791556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:53.823270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:53.823844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:53.824402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:53.824840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:53.825114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.826138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:53.826138 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.826138 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:53.826138 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.826138 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.826138 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:53.826138 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.826138 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.827185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:53.827963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:58.471658 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:58.473237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:58.509655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:58.510169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.511184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:22:58.511184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.511184 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:58.511184 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.511184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.511184 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:58.511184 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.511184 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.512165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.513454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:58.558391 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:58.559858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:58.560059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:58.564920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:58.565952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:58.566529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.566529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:58.566529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.566529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.566529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:58.566529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.566529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:58.571288 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:58.571892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:22:58.573577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:58.573867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.576395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Traceback (most recent call last):
Apr 08 13:22:58.576395 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.576395 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:58.576395 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.576395 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.576395 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:58.576395 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.576395 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:58.578890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.579773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-792f2186-2261-47af-9332-b2c32756fa16 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:22:58.580481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.581300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.582244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:58.582244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.582244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:58.785864 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:58.786570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:58.787229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:58.787721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.788659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:58.788659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.788659 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:58.788659 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.788659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.788659 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:58.788659 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.788659 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:22:58.790074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:58.790595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:22:58.790595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.790595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:22:58.790595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.790595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.790595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:22:58.790595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.790595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:22:58.791226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.791723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:58.792223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.792223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:22:58.824115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:22:58.824992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:22:58.825556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:58.825938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:22:58.826119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.826886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:22:58.826886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.826886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:22:58.826886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.826886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.826886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:22:58.826886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.826886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.828436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:22:58.829383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:03.472559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:03.475156 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:03.517450 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:03.518065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:03.520205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:03.521523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.521973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:03.521973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.521973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.521973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:03.521973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.521973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:03.559111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:03.560163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:03.560420 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:03.560581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:03.561199 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.561199 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:03.561199 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.561199 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.561199 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:03.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.561199 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.562368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.563216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:03.571945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:03.572644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:03.573857 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:03.573857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.574558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Traceback (most recent call last):
Apr 08 13:23:03.574558 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.574558 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:03.574558 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.574558 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.574558 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:03.574558 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.574558 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:03.576107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.576938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-214b90be-1164-47d0-bb76-c96f6dbb6f94 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:03.577737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.578406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.579231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:03.579231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.579231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:03.786358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:03.786823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:03.787419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:03.787701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.788299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:03.788299 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.788299 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:03.788299 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.788299 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.788299 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:03.788299 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.788299 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:03.789169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:03.789742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:03.789742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.789742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:03.789742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.789742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.789742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:03.789742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.789742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:03.790377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.790890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:03.791395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.791395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:03.824986 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:03.828043 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:03.828700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:03.829100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:03.829331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.830198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:03.830198 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.830198 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:03.830198 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.830198 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.830198 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:03.830198 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.830198 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.831063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:03.831801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:08.473947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:08.475502 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:08.519743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:08.520005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.520890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:08.520890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.520890 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:08.520890 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.520890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.520890 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:08.520890 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.520890 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.523124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.524009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:08.559841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:08.560989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:08.561312 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:08.561554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.562431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:08.562431 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.562431 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:08.562431 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.562431 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.562431 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:08.562431 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.562431 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.563705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.564897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:08.572458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:08.572801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:08.573306 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:08.573528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.574106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:23:08.574106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.574106 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:08.574106 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.574106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.574106 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:08.574106 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.574106 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:08.575134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.576141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:08.576781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.577915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.579210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:08.579210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.579210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:08.787375 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:08.788773 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:08.789338 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:08.789586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.790166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:08.790166 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.790166 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:08.790166 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.790166 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.790166 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:08.790166 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.790166 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:08.791764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:08.792078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:08.792078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.792078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:08.792078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.792078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.792078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:08.792078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.792078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:08.793364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.793716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:08.794076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.794076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:08.828092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:08.828782 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:08.829222 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:08.829704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:08.830034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.832788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:08.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:08.834537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:08.834537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:08.834537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:08.834537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:13.474483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:13.475476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:13.488080 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=246 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:23:13.503213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:13.503477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.504135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:13.504135 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.504135 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:13.504135 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.504135 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.504135 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:13.504135 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.504135 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.510887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.511596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:13.560363 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:13.561743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:13.562093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:13.562351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.563248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:13.563248 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.563248 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:13.563248 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.563248 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.563248 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:13.563248 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.563248 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.565041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.565777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:13.572891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:13.573427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:13.574100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:13.574401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.575159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:23:13.575159 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.575159 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:13.575159 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.575159 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.575159 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:13.575159 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.575159 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:13.576124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.576780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:13.577424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.578195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.579025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:13.579025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.579025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:13.788924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:13.789281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:13.789939 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:13.790236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.790895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:13.790895 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.790895 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:13.790895 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.790895 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.790895 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:13.790895 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.790895 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:13.792065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:13.792672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:13.792672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.792672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:13.792672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.792672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.792672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:13.792672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.792672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:13.793500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.794028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:13.794531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.794531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:13.831319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:13.831319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:13.831319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:13.831319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:13.831319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.831734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:13.831734 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.831734 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:13.831734 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.831734 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.831734 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:13.831734 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.831734 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.832584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:13.833321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:18.475050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:18.476863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:18.505481 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:18.505724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.506433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:18.506433 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.506433 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:18.506433 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.506433 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.506433 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:18.506433 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.506433 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.508057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.508814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:18.561080 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:18.562360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:18.562640 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:18.562922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.563797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:18.563797 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.563797 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:18.563797 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.563797 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.563797 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:18.563797 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.563797 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.565538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.566821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:18.573334 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:18.574023 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:18.574735 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:18.575091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.576185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Traceback (most recent call last):
Apr 08 13:23:18.576185 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.576185 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:18.576185 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.576185 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.576185 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:18.576185 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.576185 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:18.577754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.578197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-06eef3ba-9ab5-43ce-82d0-64827eada182 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:18.579510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.580317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.581270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:18.581270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.581270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:18.789538 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:18.790078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:18.790816 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:18.791176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.792017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:18.792017 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.792017 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:18.792017 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.792017 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.792017 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:18.792017 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.792017 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:18.793237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:18.793553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:18.793553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.793553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:18.793553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.793553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.793553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:18.793553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.793553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:18.795285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.795625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:18.796006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.796006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:18.829490 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:18.829859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:18.830339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:18.830875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:18.831186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.831966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:18.831966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.831966 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:18.831966 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.831966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.831966 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:18.831966 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.831966 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.833006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:18.833812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:23.475847 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:23.478238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:23.519173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:23.519363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.519973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:23.519973 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.519973 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:23.519973 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.519973 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.519973 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:23.519973 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.519973 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.520896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.521431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:23.561761 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:23.563495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:23.563960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:23.564271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.565272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:23.565272 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.565272 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:23.565272 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.565272 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.565272 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:23.565272 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.565272 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.567006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.567487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:23.573845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:23.574105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:23.574537 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:23.574770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:23.575238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.575238 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:23.575238 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.575238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.575238 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:23.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:23.576779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:23.577569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:23.577569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.577569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:23.577569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.577569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.577569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:23.577569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.577569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:23.578810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.579505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.580336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:23.580336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.580336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:23.790076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:23.790980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:23.792096 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:23.792441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.793305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:23.793305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.793305 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:23.793305 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.793305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.793305 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:23.793305 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.793305 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:23.794793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:23.795304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:23.795304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.795304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:23.795304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.795304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.795304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:23.795304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.795304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:23.796309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.796857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:23.797333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.797333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:23.829933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:23.830592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:23.831982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:23.832240 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:23.832399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.833260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:23.833260 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.833260 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:23.833260 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.833260 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.833260 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:23.833260 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.833260 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.834512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:23.835654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:28.476521 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:28.477854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:28.519457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:28.519918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.520652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:28.520652 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.520652 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:28.520652 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.520652 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.520652 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:28.520652 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.520652 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.521685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.522452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:28.562344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:28.563650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:28.563997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:28.564250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.565172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:28.565172 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.565172 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:28.565172 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.565172 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.565172 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:28.565172 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.565172 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.567251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.568248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:28.574428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:28.574909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:28.575433 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:28.575788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.576703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:23:28.576703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.576703 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:28.576703 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.576703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.576703 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:28.576703 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.576703 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:28.577598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.578139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:28.578405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.578889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.579430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:28.579430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.579430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:28.790859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:28.791292 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:28.791887 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:28.792182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.792803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:28.792803 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.792803 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:28.792803 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.792803 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.792803 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:28.792803 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.792803 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:28.793752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:28.794227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:28.794227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.794227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:28.794227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.794227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.794227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:28.794227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.794227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:28.794729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.795504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:28.795989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.795989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:28.830479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:28.831863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:28.831863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:28.832305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:28.832419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.833218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:28.833218 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.833218 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:28.833218 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.833218 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.833218 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:28.833218 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.833218 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.835118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:28.835607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:33.477301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:33.478640 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:33.511826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:33.512315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.513288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:33.513288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.513288 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:33.513288 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.513288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.513288 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:33.513288 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.513288 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.514372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.515324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:33.563100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:33.564293 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:33.564713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:33.564957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.565899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:33.565899 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.565899 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:33.565899 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.565899 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.565899 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:33.565899 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.565899 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.567824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.569040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:33.574883 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:33.575381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:33.575955 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:33.575955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.576793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:23:33.576793 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.576793 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:33.576793 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.576793 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.576793 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:33.576793 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.576793 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:33.578146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.578984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:33.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.580352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.580884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:33.580884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.580884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:33.791535 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:33.792842 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:33.792842 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:33.793130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.793728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:33.793728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.793728 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:33.793728 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.793728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.793728 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:33.793728 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.793728 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:33.794257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:33.794713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:33.794713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.794713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:33.794713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.794713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.794713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:33.794713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.794713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:33.795256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.795751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:33.796230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.796230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:33.831075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:33.831606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:33.832107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:33.832448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:33.832609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.833328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:33.833328 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.833328 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:33.833328 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.833328 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.833328 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:33.833328 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.833328 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.834807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:33.835573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:38.478293 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:38.480089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:38.514496 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:38.514740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.515437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:38.515437 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.515437 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:38.515437 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.515437 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.515437 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:38.515437 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.515437 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.516299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.517056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:38.563664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:38.564845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:38.565106 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:38.565269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.567877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:38.567877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.567877 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:38.567877 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.567877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.567877 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:38.567877 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.567877 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.568988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.570097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:38.575291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:38.575887 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:38.576436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:38.576792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.577538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:23:38.577538 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.577538 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:38.577538 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.577538 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.577538 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:38.577538 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.577538 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:38.578741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.579324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:38.579886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.580846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.581773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:38.581773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.581773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:38.792459 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:38.793011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:38.793724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:38.794065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.794864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:38.794864 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.794864 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:38.794864 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.794864 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.794864 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:38.794864 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.794864 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:38.796423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:38.797449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:38.797449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.797449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:38.797449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.797449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.797449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:38.797449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.797449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:38.798155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.799246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:38.800189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.800189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:38.831908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.836174 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.836833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:38.837639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:43.478989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:43.480292 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:43.519453 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:43.519724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.520378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:43.520378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.520378 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:43.520378 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.520378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.520378 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:43.520378 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.520378 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.521659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.522124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:43.564025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:43.565249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:43.565490 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:43.565760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.568344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:43.569355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.570299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.570299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:43.570299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.570299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:43.575791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:43.576940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:43.577581 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:43.577892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.578671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:23:43.578671 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.578671 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:43.578671 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.578671 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.578671 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:43.578671 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.578671 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:43.579313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.579974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:43.580375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.581379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.582231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:43.582231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.582231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:43.793246 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:43.793639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:43.794486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:43.794787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.795322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:43.795322 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.795322 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:43.795322 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.795322 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.795322 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:43.795322 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.795322 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:43.795962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:43.796388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:43.796388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.796388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:43.796388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.796388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.796388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:43.796388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.796388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:43.796715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.797374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:43.797912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.797912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:43.832656 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.839355 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.840253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:43.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:48.480137 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:48.481659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:48.520966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:48.521107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.522133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:48.522133 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.522133 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:48.522133 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.522133 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.522133 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:48.522133 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.522133 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.522844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.523414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:48.564606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:48.565767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:48.566057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:48.566322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.567211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:48.567211 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.567211 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:48.567211 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.567211 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.567211 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:48.567211 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.567211 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.569215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.570434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:48.576831 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:48.577389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:48.577980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:48.578272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.579233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:23:48.579233 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.579233 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:48.579233 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.579233 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.579233 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:48.579233 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.579233 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:48.580128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.580980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:48.581470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.582246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.583320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:48.583320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.583320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:48.793871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:48.794339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:48.795005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:48.795534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.796202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:48.796202 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.796202 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:48.796202 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.796202 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.796202 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:48.796202 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.796202 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:48.797111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:48.797667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:48.797667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.797667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:48.797667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.797667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.797667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:48.797667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.797667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:48.798126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.798568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:48.799061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.799061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:48.833442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:48.833953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:48.834837 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:48.835240 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:48.835497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.836494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:48.836494 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.836494 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:48.836494 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.836494 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.836494 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:48.836494 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.836494 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.838923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:48.839704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:53.480769 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:53.481751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:53.518341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:53.518589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.519321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:53.519321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.519321 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:53.519321 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.519321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.519321 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:53.519321 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.519321 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.520742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.521915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:53.565268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:53.566566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:53.566820 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:53.567007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.567770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:53.567770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.567770 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:53.567770 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.567770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.567770 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:53.567770 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.567770 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.569633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.570384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:53.577238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:53.577643 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:53.578130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:53.578423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.579173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:23:53.579173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.579173 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:53.579173 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.579173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.579173 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:53.579173 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.579173 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:53.579942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.580418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:53.580982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.581599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.582116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:53.582116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.582116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:53.794722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:53.795731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:53.795731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:53.795731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.796241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:53.796241 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.796241 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:53.796241 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.796241 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.796241 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:53.796241 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.796241 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:53.796941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:53.797685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:53.797685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.797685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:53.797685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.797685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.797685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:53.797685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.797685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:53.798034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.802015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:53.802833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.802833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:53.833953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:53.834427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:53.834909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:53.835253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:53.835514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.836176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:53.836176 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.836176 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:53.836176 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.836176 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.836176 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:53.836176 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.836176 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.837041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:53.837595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:58.481272 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:58.482475 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:58.515118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:58.515460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.516134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:23:58.516134 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.516134 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:58.516134 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.516134 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.516134 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:58.516134 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.516134 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.517012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.517914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:58.565964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:58.567294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:58.567600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:58.567793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.568804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:58.568804 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.568804 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:58.568804 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.568804 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.568804 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:58.568804 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.568804 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.570344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.570818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:58.577724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:58.578270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:23:58.578692 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:58.578904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.579533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:23:58.579533 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.579533 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:58.579533 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.579533 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.579533 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:58.579533 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.579533 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:58.580435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.580822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:23:58.581596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.581923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.582424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:58.582424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.582424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:58.795370 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:58.795777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:58.796344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:58.796663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.797443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:58.797443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.797443 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:58.797443 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.797443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.797443 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:58.797443 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.797443 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:23:58.798291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:58.799228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:23:58.799228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.799228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:23:58.799228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.799228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.799228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:23:58.799228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.799228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:23:58.799560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.800348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:58.801255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.801255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:23:58.834735 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:23:58.835234 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:23:58.835892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:58.835892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:23:58.836198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.837382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:23:58.837382 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.837382 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:23:58.837382 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.837382 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.837382 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:23:58.837382 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.837382 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.839181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:23:58.840074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:03.481948 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:03.483186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:03.521129 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:03.521310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.522018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:03.522018 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.522018 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:03.522018 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.522018 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.522018 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:03.522018 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.522018 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.523258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.524129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:03.566581 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:03.568054 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:03.568814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:03.569223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.572470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:03.573401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.574006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.574006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:03.574006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.574006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:03.578216 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:03.578799 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:03.579165 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:03.579357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.579877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:03.579877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.579877 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:03.579877 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.579877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.579877 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:03.579877 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.579877 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:03.580753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.581273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:03.581839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.582342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.582932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:03.582932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.582932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:03.796264 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:03.796641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:03.797269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:03.797872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.798830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:03.798830 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.798830 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:03.798830 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.798830 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.798830 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:03.798830 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.798830 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:03.799566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:03.800509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:03.800509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.800509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:03.800509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.800509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.800509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:03.800509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.800509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:03.800996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.802470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:03.803409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.803409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:03.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.838922 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.839719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:03.841034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:08.482710 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:08.484417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:08.523394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:08.523587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.524448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:08.524448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.524448 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:08.524448 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.524448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.524448 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:08.524448 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.524448 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.525790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.526271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:08.567291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:08.568668 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:08.568960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:08.569156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.569818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:08.569818 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.569818 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:08.569818 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.569818 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.569818 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:08.569818 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.569818 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.571007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.571532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:08.578813 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:08.579865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:08.580183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:08.580513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.582651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.584159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:08.584547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.584944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.585422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:08.585422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.585422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:08.796701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:08.797103 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:08.797719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:08.798025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.798979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:08.798979 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.798979 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:08.798979 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.798979 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.798979 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:08.798979 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.798979 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:08.800105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:08.800577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:08.800577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.800577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:08.800577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.800577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.800577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:08.800577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.800577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:08.800924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.801359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:08.801901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.801901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:08.836002 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:08.836593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.838399 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.839809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:08.840335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:13.483900 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:13.485903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:13.533801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:13.533801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.535420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:13.535420 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.535420 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:13.535420 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.535420 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.535420 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:13.535420 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.535420 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.536123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.537111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:13.568068 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:13.569902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:13.569902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:13.569902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.570153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:13.570153 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.570153 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:13.570153 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.570153 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.570153 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:13.570153 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.570153 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.571467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.572015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:13.579934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:13.580426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:13.581477 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:13.581477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.581802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:13.581802 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.581802 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:13.581802 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.581802 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.581802 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:13.581802 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.581802 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:13.582387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.582929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:13.583191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.583606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.584098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:13.584098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.584098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:13.797509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:13.798756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:13.800255 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:13.800255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.800377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:13.800377 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.800377 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:13.800377 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.800377 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.800377 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:13.800377 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.800377 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:13.801276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:13.801850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:13.801850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.801850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:13.801850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.801850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.801850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:13.801850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.801850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:13.802313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.803512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:13.804112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.804112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:13.836815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:13.838112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:13.839798 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:13.840225 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:13.840530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.841564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:13.841564 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.841564 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:13.841564 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.841564 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.841564 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:13.841564 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.841564 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.842913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:13.843855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:18.484655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:18.486319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:18.487822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=254 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:24:18.525959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:18.526340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.526881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:18.526881 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.526881 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:18.526881 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.526881 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.526881 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:18.526881 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.526881 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.527808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.528541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:18.568657 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:18.570018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:18.570298 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:18.570535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.571394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:18.571394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.571394 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:18.571394 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.571394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.571394 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:18.571394 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.571394 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.573116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.573961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:18.580719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:18.580963 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:18.581444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:18.581639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.582158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:18.582158 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.582158 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:18.582158 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.582158 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.582158 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:18.582158 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.582158 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:18.583088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.583938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:18.584440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.585189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.586269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:18.586269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.586269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:18.798333 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:18.798994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:18.799445 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:18.799777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.800325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:18.800325 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.800325 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:18.800325 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.800325 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.800325 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:18.800325 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.800325 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:18.801286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:18.802073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:18.802073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.802073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:18.802073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.802073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.802073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:18.802073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.802073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:18.802425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.803040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:18.803816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.803816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:18.838115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:18.838727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:18.839103 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:18.839454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:18.839692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.841813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:18.842494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:18.843157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:18.843157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:18.843157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:18.843157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:23.485309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:23.486311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:23.521938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:23.522127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.522672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:23.522672 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.522672 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:23.522672 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.522672 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.522672 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:23.522672 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.522672 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.523501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.524008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:23.569357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:23.570342 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:23.570512 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:23.570685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.571239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:23.571239 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.571239 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:23.571239 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.571239 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.571239 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:23.571239 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.571239 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.572109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:23.581087 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:23.581348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:23.581545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:23.581721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.582532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:23.582532 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.582532 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:23.582532 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.582532 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.582532 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:23.582532 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.582532 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:23.583337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.583720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:23.584536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.584939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.585371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:23.585371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.585371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:23.798985 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:23.799278 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:23.799565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:23.799791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.800243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:23.800243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.800243 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:23.800243 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.800243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.800243 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:23.800243 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.800243 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:23.800965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:23.801443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:23.801443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.801443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:23.801443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.801443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.801443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:23.801443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.801443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:23.801911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.802265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:23.802661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.802661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:23.838789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:23.839697 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:23.840032 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:23.840979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:23.840979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.841326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:23.841326 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.841326 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:23.841326 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.841326 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.841326 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:23.841326 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.841326 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.842948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:23.844003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:28.485976 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:28.486961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:28.515566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:28.515862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.516677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:28.516677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.516677 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:28.516677 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.516677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.516677 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:28.516677 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.516677 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.517905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.518738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:28.570095 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:28.571458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:28.571897 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:28.572457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.573348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:28.573348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.573348 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:28.573348 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.573348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.573348 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:28.573348 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.573348 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.575238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.575653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:28.581956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:28.582279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:28.582982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:28.584609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.585535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:28.585535 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.585535 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:28.585535 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.585535 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.585535 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:28.585535 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.585535 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:28.586472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.587034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:28.588433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.589136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.589825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:28.589825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.589825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:28.799578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:28.799808 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:28.800531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:28.801222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.802102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:28.802102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.802102 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:28.802102 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.802102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.802102 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:28.802102 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.802102 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:28.803092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:28.803603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:28.803603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.803603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:28.803603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.803603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.803603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:28.803603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.803603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:28.804170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.804684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:28.805302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.805302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:28.857644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:28.858297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:28.876124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:28.876628 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:28.876744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.877286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:28.877286 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.877286 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:28.877286 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.877286 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.877286 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:28.877286 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.877286 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.878055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:28.878918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:33.486766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:33.487891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:33.523996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:33.524404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.525441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:33.525441 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.525441 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:33.525441 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.525441 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.525441 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:33.525441 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.525441 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.527295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.527965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:33.570674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:33.571981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:33.572460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:33.572804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.573891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:33.573891 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.573891 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:33.573891 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.573891 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.573891 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:33.573891 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.573891 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.577306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.577948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:33.582457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:33.583186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:33.583615 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:33.583834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.584489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:33.584489 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.584489 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:33.584489 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.584489 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.584489 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:33.584489 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.584489 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:33.585920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.586278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:33.587514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.587870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.588226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:33.588226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.588226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:33.800097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:33.800654 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:33.801141 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:33.801591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.802405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:33.802405 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.802405 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:33.802405 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.802405 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.802405 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:33.802405 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.802405 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:33.803400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:33.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:33.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:33.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:33.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.803777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:33.804823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.805261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:33.805672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.805672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:33.858201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:33.858667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:33.859366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:33.859819 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:33.860055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.861098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:33.861098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.861098 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:33.861098 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.861098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.861098 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:33.861098 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.861098 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.862295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:33.862735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:38.487236 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:38.489679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:38.530694 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:38.531429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.532530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:38.532530 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.532530 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:38.532530 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.532530 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.532530 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:38.532530 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.532530 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.534257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.535154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:38.571197 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:38.572162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:38.572408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:38.572588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.573183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:38.573183 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.573183 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:38.573183 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.573183 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.573183 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:38.573183 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.573183 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.574359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.574896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:38.582679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:38.583094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:38.584523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:38.584979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.587646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:38.587646 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.587646 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:38.587646 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.587646 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.587646 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:38.587646 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.587646 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:38.588395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:38.589514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.591213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.592033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.825568 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:38.826348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.827132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:38.827824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.828977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:38.866357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:38.866928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:38.867442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:38.867934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:38.867934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.868428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:38.868428 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.868428 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:38.868428 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.868428 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.868428 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:38.868428 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.868428 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.869255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:38.869822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:43.487874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:43.488917 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:43.531005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:43.531207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.531717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:43.531717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.531717 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:43.531717 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.531717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.531717 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:43.531717 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.531717 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.532493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.533174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:43.571949 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:43.574741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:43.575024 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:43.575291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.576025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:43.576025 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.576025 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:43.576025 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.576025 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.576025 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:43.576025 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.576025 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.576814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.577387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:43.583245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:43.586029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:43.586568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:43.587019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.588246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:43.588246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.588246 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:43.588246 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.588246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.588246 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:43.588246 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.588246 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:43.589380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:43.590462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.591145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.592222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:43.801118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:43.801526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:43.802119 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:43.802735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.803637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:43.803637 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.803637 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:43.803637 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.803637 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.803637 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:43.803637 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.803637 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:43.805010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:43.805820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:43.805820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.805820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:43.805820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.805820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.805820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:43.805820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.805820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:43.806530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.806967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:43.807477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.807477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:43.867073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:43.867492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:43.868234 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:43.868624 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:43.868889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.869808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:43.869808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.869808 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:43.869808 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.869808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.869808 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:43.869808 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.869808 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.871746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:43.872343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:48.488461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:48.489458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:48.518276 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:48.518487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.519058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:24:48.519058 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.519058 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:48.519058 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.519058 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.519058 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:48.519058 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.519058 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.519972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.520536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:48.574194 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:48.575260 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:48.575440 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:48.575549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.576115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:48.576115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.576115 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:48.576115 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.576115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.576115 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:48.576115 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.576115 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.577046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.577410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:48.586069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:48.586745 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:48.587364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:48.587632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.588321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:24:48.588321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.588321 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:48.588321 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.588321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.588321 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:48.588321 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.588321 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:48.589257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.589593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:48.590374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.590870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.591211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:48.591211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.591211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:48.801564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:48.802021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:48.802589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:48.803057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:48.806654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.807303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:48.807645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.808074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:48.808543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.808543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:48.867815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.870816 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.871362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:48.871874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:54.745221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:54.745221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:54.745221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:54.745221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:54.745221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.161815 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:55.184299 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:55.188114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:24:55.189163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-058aca35-a9f6-4fa8-9e5c-3089fe777329 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:55.190403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.194596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.195114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:55.202865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:55.202865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.203429 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:55.203662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.204295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-058aca35-a9f6-4fa8-9e5c-3089fe777329 None None] Traceback (most recent call last):
Apr 08 13:24:55.204295 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.204295 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:55.204295 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.204295 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.204295 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:55.204295 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.204295 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-058aca35-a9f6-4fa8-9e5c-3089fe777329 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:55.209952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.210351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:55.210777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:55.210777 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.210777 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:55.210777 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.210777 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.210777 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:55.210777 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.210777 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:55.211387 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-058aca35-a9f6-4fa8-9e5c-3089fe777329 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:24:55.216911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:55.217653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.217653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:24:55.223099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:55.223491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:24:55.223491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.223491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:24:55.223491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.223491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.223491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:24:55.223491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.223491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:24:55.224596 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:24:55.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.228233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:55.228233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.228233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:55.228233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.231075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:24:55.231075 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.231075 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:55.231075 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.231075 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.231075 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:55.231075 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.231075 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.234283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.234682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:55.252536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:55.252738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.253326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Traceback (most recent call last):
Apr 08 13:24:55.253326 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.253326 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:55.253326 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.253326 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.253326 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:55.253326 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.253326 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-30176831-ab1a-45f7-9de3-3355cb1705e2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.254468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:55.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:24:59.746923 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:24:59.749098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:24:59.782759 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:24:59.783108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:59.783930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:24:59.783930 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:59.783930 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:24:59.783930 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:24:59.783930 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:59.783930 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:24:59.783930 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:59.783930 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:59.786870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:24:59.787528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:00.154403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:00.154704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:00.154862 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:00.154975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.155461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:00.155461 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.155461 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:00.155461 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.155461 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.155461 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:00.155461 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.155461 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.156427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.157038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:00.161763 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:00.162243 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:00.162812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:00.163088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.163705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:00.163705 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.163705 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:00.163705 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.163705 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.163705 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:00.163705 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.163705 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:00.165040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:00.165541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:00.165541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.165541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:00.165541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.165541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.165541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:00.165541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.165541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:00.166777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.167345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.168097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:00.168097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.168097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:00.168097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:00.168097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:00.168097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:00.168290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:00.170938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:00.170938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.171498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:00.171498 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.171498 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:00.171498 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.171498 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.171498 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:00.171498 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.171498 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:00.173234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:00.173892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:00.174572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.175406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.176373 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.177573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:00.178085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:04.748792 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:04.749699 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:04.792361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:04.792855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:04.793948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Traceback (most recent call last):
Apr 08 13:25:04.793948 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:04.793948 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:04.793948 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:04.793948 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:04.793948 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:04.793948 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:04.793948 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6e6f819e-8670-4596-b8a3-6114c372b845 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:04.794898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:04.795483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:05.154560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:05.155533 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:05.155841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:05.155979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.156660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:05.156660 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.156660 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:05.156660 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.156660 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.156660 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:05.156660 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.156660 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.157825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.158964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:05.162281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:05.162513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:05.163092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:05.163307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.163966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:05.163966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.163966 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:05.163966 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.163966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.163966 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:05.163966 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.163966 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:05.165526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:05.165879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:05.165879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.165879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:05.165879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.165879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.165879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:05.165879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.165879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:05.168003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.168385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.168799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:05.168799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.168799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:05.169728 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:05.169865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:05.170362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:05.171354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:05.172343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:05.172687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.176118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:05.176118 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.176118 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:05.176118 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.176118 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.176118 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:05.176118 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.176118 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:05.177339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:05.177690 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:05.179046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.179376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:05.179776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.179776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:05.179776 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:05.179776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.202447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:05.202447 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.202447 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:05.202447 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.202447 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.202447 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:05.202447 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.202447 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.205552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:05.206312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:09.749445 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:09.751173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ec99d54b-1827-4b24-8247-73de50e17ca5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:09.784673 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:09.785069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:09.785956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ec99d54b-1827-4b24-8247-73de50e17ca5 None None] Traceback (most recent call last):
Apr 08 13:25:09.785956 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:09.785956 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:09.785956 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:09.785956 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:09.785956 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:09.785956 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:09.785956 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-ec99d54b-1827-4b24-8247-73de50e17ca5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:09.787157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:09.787809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:10.155322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:10.156270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:10.156459 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:10.156798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.157379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:10.157379 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.157379 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:10.157379 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.157379 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.157379 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:10.157379 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.157379 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.159215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.159837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:10.162906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:10.163287 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:10.163632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:10.163873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.164333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:10.164333 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.164333 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:10.164333 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.164333 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.164333 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:10.164333 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.164333 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:10.165139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:10.166134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:10.166134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.166134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:10.166134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.166134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.166134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:10.166134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.166134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:10.166721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.167871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.168903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:10.168903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.168903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:10.170369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:10.170886 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:10.171230 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:10.171508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.172367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:10.172367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1c111765-aafc-415d-a03d-1b654972ef6c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:10.172743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Traceback (most recent call last):
Apr 08 13:25:10.172743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.172743 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:10.172743 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.172743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.172743 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:10.172743 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.172743 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:10.173581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:10.174146 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:10.174646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-4a714d52-1906-41de-894a-108a769eb285 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:10.178998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.180209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1c111765-aafc-415d-a03d-1b654972ef6c None None] Traceback (most recent call last):
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-1c111765-aafc-415d-a03d-1b654972ef6c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:10.181746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:10.182893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:10.183807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:14.750002 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:14.751567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:14.787134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:14.787320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:14.787946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Traceback (most recent call last):
Apr 08 13:25:14.787946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:14.787946 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:14.787946 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:14.787946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:14.787946 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:14.787946 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:14.787946 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8be6b6b8-ca94-4cca-8f75-5e3d6492f745 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:14.788906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:14.789450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:15.156006 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:15.157513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:15.157513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:15.157513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.157980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:15.157980 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.157980 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:15.157980 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.157980 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.157980 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:15.157980 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.157980 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.158878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.159785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:15.163800 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:15.164163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:15.164725 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:15.164935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.165508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:15.165508 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.165508 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:15.165508 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.165508 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.165508 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:15.165508 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.165508 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:15.166715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:15.167514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:15.167514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.167514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:15.167514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.167514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.167514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:15.167514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.167514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:15.168322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.169122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.170317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:15.170317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.170317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:15.170973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:15.171475 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:15.171656 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:15.171945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.172921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:15.173092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:15.173958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:15.173958 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.173958 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:15.173958 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.173958 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.173958 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:15.173958 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.173958 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:15.175507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:15.175998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:15.175998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.175998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:15.175998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.175998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.175998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:15.175998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.175998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:15.176805 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:15.176805 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:15.177792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.177900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:15.177900 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.177900 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:15.177900 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.177900 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.177900 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:15.177900 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.177900 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.180175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.180586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:15.181997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:15.182961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:15.183305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:15.183305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:19.751159 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:19.752341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3dd65c4e-8785-42ea-8b28-e14f8358ed57 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:19.753746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:25:19.796904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:19.797119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:19.797701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3dd65c4e-8785-42ea-8b28-e14f8358ed57 None None] Traceback (most recent call last):
Apr 08 13:25:19.797701 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:19.797701 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:19.797701 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:19.797701 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:19.797701 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:19.797701 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:19.797701 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3dd65c4e-8785-42ea-8b28-e14f8358ed57 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:19.798903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:19.799266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:20.156723 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:20.157711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:20.157987 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:20.158212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.159204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:20.159204 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.159204 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:20.159204 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.159204 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.159204 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:20.159204 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.159204 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.160362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.161147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:20.164037 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:20.166752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.168958 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:20.169546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:20.170071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:20.170071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.170071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:20.170071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.170071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.170071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:20.170071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.170071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:20.172434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.172887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.173357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:20.173357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.173357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:20.173357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:20.173357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:20.173589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:20.174161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:20.174536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:20.175011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.175965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:20.175965 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.175965 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:20.175965 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.175965 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.175965 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:20.175965 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.175965 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:20.179844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:20.180351 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:20.180806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.181281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:20.181786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.181786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:20.181786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:20.181786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.182262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:20.182262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.182262 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:20.182262 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.182262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.182262 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:20.182262 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.182262 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.183052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:20.183549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:23.317325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:23.327317 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 08 13:25:23.327560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104932) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 08 13:25:23.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Fixing resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:25:23.360410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, resource={'id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'name': 'private', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['b9c480ba-80ab-475b-b935-84420037c6ca', 'd4905e6d-9f85-4996-afec-3692c12d93d1'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:10:08Z', 'updated_at': '2026-04-08T13:10:12Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21658}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.360654 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.360906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c9a391e0-7fa7-4719-b96c-81fc2e60a06f, external_ids_update=None, columns={'tag': 21658}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.361103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.362251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Traceback (most recent call last):
Apr 08 13:25:23.362251 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.362251 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:23.362251 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.362251 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.362251 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:23.362251 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.362251 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Failed to fix resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.363191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.363449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.363721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:25:23.363721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.363721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:25:23.363721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Fixing resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:25:23.396200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, resource={'id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'name': 'public', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['88cc7e33-1b68-4e35-9edc-36247de507c0', 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-08T13:10:14Z', 'updated_at': '2026-04-08T13:10:22Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.396542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.396980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-83258353-9720-4502-8be2-b82538bb4ee2, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.397201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.398003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Traceback (most recent call last):
Apr 08 13:25:23.398003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.398003 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:23.398003 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.398003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.398003 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:23.398003 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.398003 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Failed to fix resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.399821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.400215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.400598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:25:23.400598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.400598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:25:23.400598 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Fixing resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:25:23.428999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, resource={'id': 'a5d505fb-12e2-4aed-8078-02b88b929c5e', 'name': 'admin_net', 'tenant_id': '98be377457d344c7834b290dc92d0dda', 'project_id': '98be377457d344c7834b290dc92d0dda', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['39438f35-bd24-4a86-8cab-99f980e8887d'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:05Z', 'updated_at': '2026-04-08T13:14:07Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 13489}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.429292 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.429633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-daf5372b-8660-44b8-b300-e46a7451059b, external_ids_update=None, columns={'tag': 13489}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.429768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.430502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Traceback (most recent call last):
Apr 08 13:25:23.430502 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.430502 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:23.430502 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.430502 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.430502 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:23.430502 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.430502 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Failed to fix resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.431518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.431849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.432244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:25:23.432244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.432244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:25:23.432244 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Fixing resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:25:23.458091 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-daec8bf3-7182-4be9-bfe4-655236471090, resource={'id': 'daec8bf3-7182-4be9-bfe4-655236471090', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['28da0a33-78ce-48f8-89df-3533da3ec3de'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:49Z', 'updated_at': '2026-04-08T13:14:49Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 54317}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.458536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-daec8bf3-7182-4be9-bfe4-655236471090, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.459195 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-4b03e103-5c09-4760-adf8-c6bbd598718a, external_ids_update=None, columns={'tag': 54317}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.459462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.460497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Traceback (most recent call last):
Apr 08 13:25:23.460497 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.460497 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:23.460497 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.460497 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.460497 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:23.460497 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.460497 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Failed to fix resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.461781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.462120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.462534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:25:23.462534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.462534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:25:23.462534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Fixing resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:25:23.542159 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, resource={'id': '71709845-924e-42fd-985e-d000e2c61286', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'enable_snat': True}, 'gw_port_id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-az3g9', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'ip_address': '172.24.5.223', 'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'}, {'ip_address': '2001:db8::19', 'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 3, 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985'}, resource_type=routers, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.542493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.542711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.542865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.543005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.543740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Traceback (most recent call last):
Apr 08 13:25:23.543740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.543740 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:23.543740 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.543740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.543740 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:23.543740 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.543740 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:23.544013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Unable to update router 71709845-924e-42fd-985e-d000e2c61286. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Failed to fix resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 08 13:25:23.546067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:25:23.546439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:25:23.546873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Fixing resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:25:23.647763 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, resource={'id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'name': '', 'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'project_id': '', 'mac_address': 'fa:16:3e:d4:5c:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71709845-924e-42fd-985e-d000e2c61286', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164309', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.648016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5 88cc7e33-1b68-4e35-9edc-36247de507c0', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-71709845-924e-42fd-985e-d000e2c61286'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.223/24', '2001:db8::19/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.648355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=59fc94c5-b567-475a-b3a9-f77ef27251c0, lrouter_port=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:23.648698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.649516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Traceback (most recent call last):
Apr 08 13:25:23.649516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.649516 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:23.649516 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.649516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.649516 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:23.649516 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.649516 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Failed to fix resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.651153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:25:23.651704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:23.652124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:25:23.652124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:23.652124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:25:23.652124 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-67bf771d-debd-4895-b81b-ab4b3a1ce0b4 None None] Maintenance task: Synchronization completed (took 0.32 seconds)
Apr 08 13:25:24.751729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:24.753857 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ec6df974-d06c-49c3-b337-0ae21cda9c5a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:24.795271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:24.796685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:24.798184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ec6df974-d06c-49c3-b337-0ae21cda9c5a None None] Traceback (most recent call last):
Apr 08 13:25:24.798184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:24.798184 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:24.798184 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:24.798184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:24.798184 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:24.798184 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:24.798184 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-ec6df974-d06c-49c3-b337-0ae21cda9c5a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:24.799111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:24.800275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:25.157350 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:25.158653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:25.159524 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:25.159874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.160891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:25.160891 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.160891 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:25.160891 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.160891 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.160891 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:25.160891 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.160891 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.162787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.163391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:25.166974 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:25.167191 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:25.167545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:25.167837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.168574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:25.168574 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.168574 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:25.168574 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.168574 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.168574 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:25.168574 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.168574 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:25.169545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:25.170295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:25.170295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.170295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:25.170295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.170295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.170295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:25.170295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.170295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:25.170535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.170949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.171434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:25.171434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.171434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:25.173317 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:25.173740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:25.174359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:25.174526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.175220 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:25.175674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:25:25.175674 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.175674 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:25.175674 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.175674 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.175674 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:25.175674 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.175674 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:25.177247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:25.178081 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:25.179146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.179558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:25.180010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.180010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:25.180010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:25.180010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:25.180010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.181108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:25.181108 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.181108 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:25.181108 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.181108 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.181108 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:25.181108 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.181108 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.183027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:25.183387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:29.752679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:29.754718 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-66649414-279c-498f-96ee-2bc9efeb3d44 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:29.801747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:29.802008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:29.802745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-66649414-279c-498f-96ee-2bc9efeb3d44 None None] Traceback (most recent call last):
Apr 08 13:25:29.802745 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:29.802745 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:29.802745 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:29.802745 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:29.802745 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:29.802745 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:29.802745 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-66649414-279c-498f-96ee-2bc9efeb3d44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:29.804904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:29.805393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:30.157999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:30.159184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:30.159184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:30.159434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.160069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:30.160069 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.160069 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:30.160069 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.160069 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.160069 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:30.160069 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.160069 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.161276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.161971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:30.167425 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:30.168041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:30.168320 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:30.168747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.169686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:30.169686 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.169686 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:30.169686 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.169686 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.169686 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:30.169686 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.169686 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:30.170933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.172170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:30.173244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:30.174201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:30.174999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:30.174999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.175361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:25:30.175361 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.175361 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:30.175361 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.175361 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.175361 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:30.175361 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.175361 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:30.176206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:30.176576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:30.177890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.178260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:30.178593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.178593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:30.178593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:30.178796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:30.179038 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:30.179178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.179659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:30.179659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.179659 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:30.179659 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.179659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.179659 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:30.179659 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.179659 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.180544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:30.180919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:34.753839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:34.755726 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f478c748-9729-45eb-92dd-a7f8dfdcfdcb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:34.793644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:34.793921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:34.794745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f478c748-9729-45eb-92dd-a7f8dfdcfdcb None None] Traceback (most recent call last):
Apr 08 13:25:34.794745 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:34.794745 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:34.794745 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:34.794745 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:34.794745 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:34.794745 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:34.794745 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-f478c748-9729-45eb-92dd-a7f8dfdcfdcb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:34.796242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:34.796954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:35.158644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:35.159843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:35.160122 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:35.160279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.160938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:35.160938 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.160938 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:35.160938 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.160938 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.160938 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:35.160938 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.160938 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.162645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.163328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:35.168431 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:35.169476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:35.170352 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:35.170858 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.172465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:35.172465 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.172465 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:35.172465 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.172465 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.172465 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:35.172465 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.172465 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:35.173483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:35.174118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:35.174118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.174118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:35.174118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.174118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.174118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:35.174118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.174118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:35.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.179633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.180226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:35.180226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.180226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:35.181566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:35.181846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:35.182226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:35.182880 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:35.184655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:35.185244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.187049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:35.187049 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.187049 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:35.187049 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.187049 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.187049 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:35.187049 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.187049 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:35.190927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:35.191384 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:35.192323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.192726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:35.193150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.193150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:35.193150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:35.193150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.193724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:35.193724 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.193724 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:35.193724 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.193724 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.193724 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:35.193724 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.193724 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.195123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:35.195914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:39.754575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:39.755917 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0a321ff-2845-4be6-bc14-544af141d7bd None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:39.813773 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:39.814492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:39.814712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0a321ff-2845-4be6-bc14-544af141d7bd None None] Traceback (most recent call last):
Apr 08 13:25:39.814712 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:39.814712 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:39.814712 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:39.814712 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:39.814712 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:39.814712 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:39.814712 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-d0a321ff-2845-4be6-bc14-544af141d7bd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:39.815929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:39.816417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:40.159433 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:40.160576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:40.162208 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:40.162208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.163702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:40.163702 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.163702 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:40.163702 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.163702 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.163702 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:40.163702 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.163702 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.164886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.165776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:40.169292 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:40.169843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:40.170823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:40.170823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.171006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:25:40.171006 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.171006 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:40.171006 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.171006 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.171006 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:40.171006 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.171006 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:40.171890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.172366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:40.172877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.173360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.173893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:40.173893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.173893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:40.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:40.183328 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:40.183751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:40.184304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:40.186358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:40.187170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.187360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Traceback (most recent call last):
Apr 08 13:25:40.187360 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.187360 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:40.187360 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.187360 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.187360 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:40.187360 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.187360 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:40.189644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.190236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-006948b9-ee48-49c4-a45e-af56423b11ee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:40.191948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.192483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:40.193054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.193054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:40.194435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:40.194435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:40.194435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.194896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Traceback (most recent call last):
Apr 08 13:25:40.194896 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.194896 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:40.194896 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.194896 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.194896 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:40.194896 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.194896 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6ef033f2-55c8-4e3a-816b-17213816504c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.196356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:40.196904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:44.755187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:44.757051 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6dc4545e-a810-456a-810b-764e920f8578 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:44.803651 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:44.804055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:44.805321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6dc4545e-a810-456a-810b-764e920f8578 None None] Traceback (most recent call last):
Apr 08 13:25:44.805321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:44.805321 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:44.805321 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:44.805321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:44.805321 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:44.805321 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:44.805321 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-6dc4545e-a810-456a-810b-764e920f8578 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:44.806800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:44.807474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:45.160227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:45.161631 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:45.161991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:45.162226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.163125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:45.163125 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.163125 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:45.163125 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.163125 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.163125 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:45.163125 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.163125 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.164330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.164998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:45.169924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:45.170544 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:45.171064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:45.171305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.173836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:25:45.173836 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.173836 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:45.173836 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.173836 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.173836 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:45.173836 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.173836 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:45.174669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.175286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:45.175844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.176478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.177308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:45.177308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.177308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:45.183929 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:45.184378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:45.184670 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:45.184961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:45.185575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:45.185994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.186378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:45.186378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.186378 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:45.186378 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.186378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.186378 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:45.186378 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.186378 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:45.187539 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:45.188296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:45.188929 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:45.190477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.191028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:45.191661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.191661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:45.191661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.191812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:45.191812 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.191812 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:45.191812 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.191812 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.191812 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:45.191812 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.191812 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.192882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:45.193380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:49.756654 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:49.757971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b9d0da03-6cb0-4a5b-8f49-f49d9f174a9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:49.798639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:49.798924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:49.799893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9d0da03-6cb0-4a5b-8f49-f49d9f174a9a None None] Traceback (most recent call last):
Apr 08 13:25:49.799893 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:49.799893 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:49.799893 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:49.799893 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:49.799893 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:49.799893 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:49.799893 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b9d0da03-6cb0-4a5b-8f49-f49d9f174a9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:49.801590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:49.802176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:50.160983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:50.162082 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:50.162314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:50.162725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.163341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:50.163341 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.163341 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:50.163341 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.163341 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.163341 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:50.163341 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.163341 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.165187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.165900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:50.170836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:50.171419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:50.171694 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:50.172123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.172797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:25:50.172797 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.172797 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:50.172797 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.172797 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.172797 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:50.172797 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.172797 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:50.173888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.174867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:50.175835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.176801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.177478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:50.177478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.177478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:50.184439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:50.184868 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:50.185155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:50.185622 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:50.186045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:50.186813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.187780 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:50.188135 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:50.188464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.188915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:50.188915 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.188915 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:50.188915 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.188915 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.188915 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:50.188915 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.188915 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:50.191099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:50.191650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:50.191650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.191650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:50.191650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.191650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.191650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:50.191650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.191650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:50.192546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.193206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.193722 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.195293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:50.196800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:54.757218 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:54.759841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:54.798564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:54.798953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:54.799591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:25:54.799591 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:54.799591 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:54.799591 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:54.799591 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:54.799591 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:54.799591 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:54.799591 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:54.800564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:54.801201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:55.161564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:55.162814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:55.163001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:55.163122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.163856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:25:55.163856 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.163856 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:55.163856 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.163856 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.163856 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:55.163856 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.163856 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:55.165122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.165523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:55.205540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:55.205540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:55.205540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:55.205540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:25:55.205540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:55.205540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:55.206902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.207394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:25:55.207810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.208167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.208553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:55.208553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.208553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:55.208553 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:55.208553 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:55.208871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.209492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:55.209705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:55.209824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.211557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:25:55.211557 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.211557 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:55.211557 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.211557 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.211557 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:55.211557 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.211557 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:25:55.212296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:55.212635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:25:55.212635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.212635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:25:55.212635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.212635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.212635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:25:55.212635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.212635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:25:55.213642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.214771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.215321 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.218660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:55.219260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:25:59.758034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:25:59.759751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:25:59.797404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:25:59.798335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:59.799015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:25:59.799015 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:59.799015 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:25:59.799015 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:25:59.799015 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:59.799015 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:25:59.799015 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:59.799015 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:59.800362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:25:59.801211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:00.162465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:00.163950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:00.164666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:00.164666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.165232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:00.165232 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.165232 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:00.165232 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.165232 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.165232 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:00.165232 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.165232 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:00.167311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.168363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:00.202742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:00.203282 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:00.203851 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:00.204085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.204867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:00.204867 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.204867 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:00.204867 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.204867 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.204867 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:00.204867 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.204867 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:00.206580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:00.207871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:00.209315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.209792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.210245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:00.210245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.210245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:00.210245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:00.211363 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:00.212012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:00.212463 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:00.212822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.213879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:00.213879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.213879 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:00.213879 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.213879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.213879 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:00.213879 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.213879 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:00.215134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:00.215521 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:00.215845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:00.215845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:00.217390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.217833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.218232 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.218595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:00.219078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:04.758730 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:04.760715 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:04.803880 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:04.804259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:04.805094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:04.805094 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:04.805094 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:04.805094 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:04.805094 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:04.805094 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:04.805094 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:04.805094 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:04.805989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:04.807196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:05.163185 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:05.164329 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:05.164765 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:05.165116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.166206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:05.166206 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.166206 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:05.166206 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.166206 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.166206 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:05.166206 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.166206 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:05.167458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.167993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:05.203355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:05.204307 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:05.204307 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:05.205038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.205770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:05.205770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.205770 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:05.205770 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.205770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.205770 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:05.205770 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.205770 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:05.207119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.208236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:05.209054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.210030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:05.211410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:05.211875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:05.212259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:05.212629 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:05.213563 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:05.213563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.213853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:05.213853 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.213853 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:05.213853 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.213853 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.213853 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:05.213853 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.213853 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:05.215079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:05.216086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:05.216778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:05.217683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.218325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:05.219240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:05.220277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:05.220277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:05.220277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:05.220277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:05.220277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:05.220277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:05.220277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:09.759313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:09.760419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:09.798749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:09.799830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:09.800366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:09.800366 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:09.800366 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:09.800366 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:09.800366 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:09.800366 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:09.800366 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:09.800366 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:09.802547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:09.803109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:10.163809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:10.165360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:10.165816 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:10.166072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.166833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:10.166833 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.166833 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:10.166833 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.166833 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.166833 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:10.166833 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.166833 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:10.168069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.168823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:10.203858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:10.204285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:10.205005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:10.205303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.206068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:10.206068 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.206068 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:10.206068 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.206068 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.206068 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:10.206068 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.206068 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:10.207431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:10.208166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:10.208166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.208166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:10.208166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.208166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.208166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:10.208166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.208166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:10.209135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.209925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.210310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:10.210310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.210310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:10.213084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:10.213333 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:10.213670 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:10.214799 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:10.215065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:10.215829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.215939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:10.215939 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.215939 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:10.215939 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.215939 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.215939 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:10.215939 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.215939 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:10.216639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.217142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:10.217588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:10.220821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.222071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.222549 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.223130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:10.223594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:14.760025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:14.762040 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:14.798726 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:14.798985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:14.799800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:14.799800 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:14.799800 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:14.799800 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:14.799800 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:14.799800 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:14.799800 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:14.799800 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:14.801063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:14.801481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:15.164308 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:15.165713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:15.166162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:15.166850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.168101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:15.168101 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.168101 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:15.168101 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.168101 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.168101 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:15.168101 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.168101 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:15.169979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.170522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:15.204342 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:15.204723 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:15.205210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:15.205428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.205979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:15.205979 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.205979 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:15.205979 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.205979 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.205979 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:15.205979 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.205979 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:15.206653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:15.207087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:15.207087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.207087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:15.207087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.207087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.207087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:15.207087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.207087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:15.207559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.208302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.209074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:15.209074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.209074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:15.213545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:15.214395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:15.214898 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:15.215633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:15.216026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.216919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:15.216919 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.216919 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:15.216919 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.216919 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.216919 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:15.216919 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.216919 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:15.217285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:15.218571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:15.219200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:15.220173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.220797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:15.221204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.221204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:15.221204 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:15.221204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.221570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:15.221570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.221570 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:15.221570 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.221570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.221570 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:15.221570 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.221570 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.222995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:15.223349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:19.760401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:19.761834 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:19.763335 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=434 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:26:19.800860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:19.801071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:19.801776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:19.801776 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:19.801776 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:19.801776 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:19.801776 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:19.801776 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:19.801776 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:19.801776 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:19.802968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:19.803635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:20.164922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:20.165890 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:20.166117 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:20.166281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:20.168268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:20.168828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.169328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:20.169328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.169328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.169328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:20.169328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.169328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:20.205058 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:20.205475 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:20.206261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:20.206574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.207296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:20.207296 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.207296 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:20.207296 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.207296 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.207296 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:20.207296 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.207296 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:20.208758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:20.209412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:20.209412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.209412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:20.209412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.209412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.209412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:20.209412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.209412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:20.210400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.211116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.211954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:20.211954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.211954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:20.214872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:20.215063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:20.215696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:20.216315 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:20.216859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:20.217325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.218252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:20.218252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.218252 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:20.218252 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.218252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.218252 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:20.218252 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.218252 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:20.219920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:20.220324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:20.222200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.222721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:20.223200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.223200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:20.223200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:20.223200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.223418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:20.223418 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.223418 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:20.223418 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.223418 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.223418 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:20.223418 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.223418 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.224836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:20.225942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:24.761056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:24.762265 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:24.798834 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:24.799126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:24.799880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:24.799880 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:24.799880 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:24.799880 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:24.799880 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:24.799880 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:24.799880 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:24.799880 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:24.801804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:24.802330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:25.165568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:25.168213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:25.168502 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:25.169405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.169854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:25.169854 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.169854 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:25.169854 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.169854 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.169854 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:25.169854 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.169854 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:25.173125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.173828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:25.205823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:25.206165 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:25.206389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:25.206808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.207837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:25.207837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.207837 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:25.207837 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.207837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.207837 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:25.207837 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.207837 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:25.208163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:25.208910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:25.208910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.208910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:25.208910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.208910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.208910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:25.208910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.208910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:25.209303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.209961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.213705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:25.213705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.213705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:25.215662 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:25.216674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:25.217707 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:25.218725 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:25.219192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.219827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:25.220681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:25.220681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:25.220905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.222285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:25.222285 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.222285 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:25.222285 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.222285 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.222285 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:25.222285 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.222285 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:25.224199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.224730 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.225961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.226763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:25.227513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:25.228249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:25.229101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:25.229101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:29.761714 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:29.763361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:29.809964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:29.810692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:29.811575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:29.811575 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:29.811575 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:29.811575 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:29.811575 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:29.811575 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:29.811575 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:29.811575 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:29.812700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:29.813101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:30.166919 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:30.168050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:30.168050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:30.168291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.168880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:30.168880 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.168880 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:30.168880 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.168880 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.168880 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:30.168880 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.168880 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:30.170350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.171189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:30.206407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:30.207067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:30.207989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:30.208219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.208863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:30.208863 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.208863 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:30.208863 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.208863 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.208863 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:30.208863 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.208863 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:30.210049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:30.210456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:30.210456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.210456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:30.210456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.210456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.210456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:30.210456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.210456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:30.211098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.212163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.212942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:30.212942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.212942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:30.216461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:30.217015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:30.217466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:30.217800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.218452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:30.218452 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.218452 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:30.218452 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.218452 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.218452 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:30.218452 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.218452 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:30.219363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.220040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:30.220251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.220680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:30.221783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.221783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:30.221783 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:30.221783 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:30.221783 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:30.222075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:30.222446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.223799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:30.223799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.223799 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:30.223799 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.223799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.223799 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:30.223799 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.223799 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.225766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:30.226243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:34.762270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:34.764571 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:34.799417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:34.799857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:34.800778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:34.800778 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:34.800778 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:34.800778 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:34.800778 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:34.800778 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:34.800778 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:34.800778 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:34.802563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:34.803929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:35.167492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:35.168790 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:35.169065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:35.169308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.170262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:35.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:35.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:35.170262 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.170262 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:35.172185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.173193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:35.207122 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:35.208021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:35.208246 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:35.208805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.208879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:35.208879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.208879 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:35.208879 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.208879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.208879 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:35.208879 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.208879 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:35.210405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:35.211514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:35.211514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.211514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:35.211514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.211514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.211514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:35.211514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.211514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:35.212268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.213239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.214328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:35.214328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.214328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:35.217109 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:35.263003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:35.263717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:35.264557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:35.265307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:35.266330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:35.267040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:35.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:35.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:39.762994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:39.763987 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:39.799755 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:39.799755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:39.799998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:39.799998 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:39.799998 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:39.799998 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:39.799998 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:39.799998 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:39.799998 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:39.799998 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:39.801198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:39.802082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:40.168132 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:40.169135 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:40.169373 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:40.169589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.170262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:40.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:40.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.170262 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:40.170262 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.170262 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:40.171602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.172239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:40.207781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:40.209168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:40.209861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:40.210180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.211968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:40.211968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.211968 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:40.211968 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.211968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.211968 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:40.211968 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.211968 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:40.212999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.213915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:40.214238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.214892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:40.217725 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:40.218284 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:40.218762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:40.219036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.219518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:40.219518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.219518 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:40.219518 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.219518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.219518 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:40.219518 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.219518 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:40.220492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.220932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:40.221605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.222065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:40.222405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.222405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:40.222405 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.224676 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.225810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:40.227045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:44.763536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:44.764598 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:44.796873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:44.797364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:44.798410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:44.798410 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:44.798410 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:44.798410 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:44.798410 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:44.798410 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:44.798410 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:44.798410 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:44.799603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:44.800341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:45.168597 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:45.170625 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:45.170625 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:45.170625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.171737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:45.171737 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.171737 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:45.171737 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.171737 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.171737 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:45.171737 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.171737 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:45.173017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.173606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:45.209056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:45.209452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:45.209902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:45.210223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.210630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:45.210630 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.210630 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:45.210630 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.210630 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.210630 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:45.210630 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.210630 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:45.211359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:45.212245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:45.212245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.212245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:45.212245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.212245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.212245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:45.212245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.212245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:45.212864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.213554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.214504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:45.214504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.214504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:45.218594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:45.219676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:45.220082 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:45.220221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.220867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:45.220867 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.220867 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:45.220867 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.220867 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.220867 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:45.220867 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.220867 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:45.222533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.222976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:45.225160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.226257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:45.226989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.226989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:45.226989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:45.226989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:45.226989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:45.226989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:45.226989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.227522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:45.227522 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.227522 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:45.227522 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.227522 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.227522 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:45.227522 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.227522 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.229133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:45.229965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:49.766655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:49.766655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:49.801452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:49.801856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:49.802764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:49.802764 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:49.802764 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:49.802764 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:49.802764 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:49.802764 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:49.802764 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:49.802764 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:49.804311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:49.804953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:50.169314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:50.170413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:50.171320 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:50.171320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.171752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:50.171752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.171752 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:50.171752 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.171752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.171752 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:50.171752 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.171752 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:50.172956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.173358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:50.209661 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:50.210257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:50.210965 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:50.211155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.211665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:50.211665 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.211665 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:50.211665 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.211665 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.211665 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:50.211665 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.211665 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:50.212332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.213302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:50.214123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.214979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:50.219491 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:50.219950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:50.220526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:50.220851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.221644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:50.221644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.221644 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:50.221644 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.221644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.221644 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:50.221644 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.221644 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:50.222783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.223232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:50.224151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.224683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:50.225201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.225201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:50.225874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:50.226248 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:50.226553 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:50.226822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:50.226958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.227454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:50.227454 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.227454 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:50.227454 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.227454 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.227454 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:50.227454 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.227454 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.229721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:50.230548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:54.765936 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:54.768884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:54.804933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:54.805430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:54.806743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:54.806743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:54.806743 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:54.806743 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:54.806743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:54.806743 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:54.806743 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:54.806743 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:54.807527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:54.808060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:55.170065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:55.171443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:55.171443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:55.171675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.172446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:26:55.172446 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.172446 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:55.172446 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.172446 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.172446 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:55.172446 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.172446 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:55.174334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.175299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:55.210317 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:55.210965 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:26:55.211721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:55.212158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.213188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:26:55.213188 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.213188 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:55.213188 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.213188 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.213188 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:55.213188 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.213188 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:55.214769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:55.215327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:55.215327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.215327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:55.215327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.215327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.215327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:55.215327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.215327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:26:55.216600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.217034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.217500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:55.217500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.217500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:55.219878 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:55.220438 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:55.220907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:55.221154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.221890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:26:55.221890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.221890 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:55.221890 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.221890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.221890 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:55.221890 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.221890 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:26:55.223317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.223755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:26:55.225238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.225678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:55.226139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.226139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:55.226563 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:55.226772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:55.227168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:55.227757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:55.227937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.228897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:26:55.228897 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.228897 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:55.228897 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.228897 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.228897 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:55.228897 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.228897 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.230140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:55.230590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:26:59.767426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:26:59.768500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:59.805897 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:59.807942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:26:59.808720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:00.170715 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:00.171916 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:00.172213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:00.172469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.173343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:00.173343 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.173343 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:00.173343 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.173343 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.173343 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:00.173343 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.173343 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:00.174496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.175364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:00.210963 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:00.211545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:00.212339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:00.212551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.213089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:00.213089 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.213089 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:00.213089 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.213089 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.213089 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:00.213089 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.213089 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:00.214068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:00.215041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:00.215041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.215041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:00.215041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.215041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.215041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:00.215041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.215041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:00.215467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.216385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.217309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:00.217309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.217309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:00.220335 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:00.220878 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:00.221493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:00.222121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.223070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:00.223070 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.223070 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:00.223070 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.223070 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.223070 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:00.223070 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.223070 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:00.223810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.224141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:00.225135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.225479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:00.225821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.225821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:00.226502 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:00.227319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:00.227806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:00.228100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:00.228311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.228968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:00.228968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.228968 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:00.228968 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.228968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.228968 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:00.228968 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.228968 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.231635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:00.232297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:04.767911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:04.769231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:04.805582 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:04.805871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:04.806519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:04.806519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:04.806519 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:04.806519 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:04.806519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:04.806519 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:04.806519 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:04.806519 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:04.807785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:04.808597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:05.171322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:05.172586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:05.172978 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:05.173229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.173701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:05.173701 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.173701 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:05.173701 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.173701 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.173701 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:05.173701 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.173701 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:05.174607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.175183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:05.211516 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:05.212194 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:05.212980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:05.213434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.214649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:05.214649 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.214649 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:05.214649 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.214649 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.214649 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:05.214649 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.214649 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:05.216468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:05.216991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:05.216991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.216991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:05.216991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.216991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.216991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:05.216991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.216991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:05.218431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.218923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.219629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:05.219629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.219629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:05.220687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:05.221397 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:05.221856 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:05.222093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.222788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:05.222788 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.222788 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:05.222788 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.222788 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.222788 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:05.222788 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.222788 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:05.224510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.224918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:05.226590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.227037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:05.227518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.227518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:05.227518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:05.227518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:05.227663 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:05.227833 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:05.227975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.228656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:05.228656 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.228656 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:05.228656 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.228656 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.228656 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:05.228656 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.228656 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.230320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:05.230795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:09.768803 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:09.770294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:09.802742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:09.802930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:09.804269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:09.804269 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:09.804269 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:09.804269 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:09.804269 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:09.804269 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:09.804269 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:09.804269 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:09.806470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:09.807516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:10.172127 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:10.173185 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:10.173337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:10.173482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.174384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:10.174384 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.174384 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:10.174384 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.174384 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.174384 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:10.174384 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.174384 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:10.175519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.176768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:10.212192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:10.212640 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:10.212997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:10.213151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.213577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:10.213577 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.213577 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:10.213577 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.213577 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.213577 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:10.213577 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.213577 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:10.214262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.215130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:10.216024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.216973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:10.221762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:10.222181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:10.222888 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:10.223242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.223961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:10.223961 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.223961 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:10.223961 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.223961 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.223961 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:10.223961 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.223961 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:10.224600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.225048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:10.225900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.226744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:10.227372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.227372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:10.227372 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:10.227797 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:10.228740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:10.228740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:10.228740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.229005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:10.229005 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.229005 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:10.229005 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.229005 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.229005 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:10.229005 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.229005 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.230411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:10.231250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:14.769510 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:14.771589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:14.812941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:14.813079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:14.813538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:14.813538 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:14.813538 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:14.813538 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:14.813538 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:14.813538 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:14.813538 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:14.813538 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:14.814639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:14.815267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:15.173077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:15.174113 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:15.174297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:15.174446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.176223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:15.176223 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.176223 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:15.176223 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.176223 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.176223 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:15.176223 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.176223 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:15.177711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.178314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:15.212910 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:15.213451 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:15.214257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:15.214487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.215114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:15.215114 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.215114 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:15.215114 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.215114 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.215114 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:15.215114 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.215114 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:15.216423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:15.217133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:15.217133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.217133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:15.217133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.217133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.217133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:15.217133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.217133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:15.218134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.218503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.218976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:15.218976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.218976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:15.222489 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:15.222755 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:15.223164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:15.223454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.224023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:15.224023 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.224023 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:15.224023 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.224023 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.224023 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:15.224023 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.224023 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:15.224956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.225361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:15.226503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.226953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:15.227419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.227419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:15.228178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:15.228650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:15.228875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:15.229101 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:15.229250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.229791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:15.229791 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.229791 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:15.229791 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.229791 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.229791 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:15.229791 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.229791 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.231470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:15.232089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:19.770316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:19.772676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:19.774418 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:27:19.810650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:19.810865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:19.811462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:19.811462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:19.811462 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:19.811462 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:19.811462 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:19.811462 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:19.811462 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:19.811462 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:19.812506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:19.813503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:20.173711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:20.174739 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:20.175090 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:20.175380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.176804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:20.176804 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.176804 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:20.176804 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.176804 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.176804 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:20.176804 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.176804 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:20.178023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.178504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:20.213634 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:20.214082 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:20.214845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:20.215119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.215757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:20.215757 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.215757 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:20.215757 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.215757 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.215757 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:20.215757 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.215757 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:20.216571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:20.217137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:20.217137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.217137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:20.217137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.217137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.217137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:20.217137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.217137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:20.218023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.218825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.219554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:20.219554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.219554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:20.222637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:20.223312 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:20.223938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:20.224161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.224886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:20.224886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.224886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:20.224886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.224886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.224886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:20.224886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.224886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:20.226280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.226967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:20.228626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.229342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:20.230067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.230067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:20.230067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:20.230067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:20.230325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:20.230593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:20.230763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.231384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:20.231384 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.231384 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:20.231384 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.231384 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.231384 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:20.231384 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.231384 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.232588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:20.233727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:24.771981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:24.773043 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:24.811203 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:24.811406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:24.811962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:24.811962 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:24.811962 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:24.811962 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:24.811962 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:24.811962 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:24.811962 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:24.811962 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:24.813058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:24.813404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:25.174346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:25.175490 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:25.175770 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:25.175932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.177020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:25.177020 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.177020 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:25.177020 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.177020 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.177020 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:25.177020 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.177020 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:25.178142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.178843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:25.214333 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:25.214775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:25.216053 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:25.216478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.217690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:25.217690 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.217690 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:25.217690 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.217690 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.217690 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:25.217690 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.217690 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:25.218647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:25.219316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:25.219316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.219316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:25.219316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.219316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.219316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:25.219316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.219316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:25.220121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.220509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.221032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:25.221032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.221032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:25.223074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:25.223550 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:25.223943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:25.224238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.224805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:25.224805 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.224805 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:25.224805 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.224805 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.224805 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:25.224805 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.224805 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:25.225836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.226411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:25.227095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.227662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:25.228656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.228656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:25.229683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:25.230359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:25.230791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:25.231047 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:25.231225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.233424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:25.233424 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.233424 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:25.233424 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.233424 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.233424 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:25.233424 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.233424 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.236523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:25.237059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:29.771978 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:29.773647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:29.809417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:29.809637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:29.809995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:29.809995 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:29.809995 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:29.809995 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:29.809995 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:29.809995 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:29.809995 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:29.809995 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:29.810816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:29.811323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:30.175014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:30.176332 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:30.176757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:30.177076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.177951 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:30.177951 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.177951 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:30.177951 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.177951 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.177951 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:30.177951 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.177951 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:30.179265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.179786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:30.215019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:30.215880 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:30.216466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:30.216758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.217561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:30.217561 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.217561 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:30.217561 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.217561 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.217561 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:30.217561 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.217561 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:30.219150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:30.219980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:30.219980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.219980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:30.219980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.219980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.219980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:30.219980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.219980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:30.221443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.222163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.223205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:30.223205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.223205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:30.223542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:30.224494 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:30.225883 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:30.226377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.227474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:30.227474 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.227474 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:30.227474 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.227474 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.227474 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:30.227474 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.227474 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:30.228384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.228958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:30.229531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.230051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:30.230547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.230547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:30.230547 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:30.231027 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:30.231409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:30.231703 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:30.232172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.232476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:30.232476 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.232476 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:30.232476 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.232476 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.232476 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:30.232476 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.232476 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.233626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:30.234177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:34.772904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:34.774279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:34.806709 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:34.807049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:34.807877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:34.807877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:34.807877 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:34.807877 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:34.807877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:34.807877 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:34.807877 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:34.807877 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:34.808556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:34.809118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:35.175451 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:35.176607 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:35.176813 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:35.176929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.178572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:35.178572 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.178572 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:35.178572 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.178572 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.178572 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:35.178572 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.178572 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:35.179854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.180316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:35.215655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:35.216850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:35.216930 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:35.217115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.217698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:35.217698 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.217698 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:35.217698 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.217698 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.217698 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:35.217698 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.217698 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:35.219932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:35.220634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:35.220634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.220634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:35.220634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.220634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.220634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:35.220634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.220634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:35.222313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.222798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.223308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:35.223308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.223308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:35.224074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:35.224457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:35.224963 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:35.225227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.225972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:35.225972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.225972 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:35.225972 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.225972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.225972 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:35.225972 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.225972 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:35.227001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.227704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:35.228761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.229318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:35.229907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.229907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:35.230999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:35.231477 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:35.231908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:35.232017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:35.232215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.232668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:35.232668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.232668 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:35.232668 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.232668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.232668 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:35.232668 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.232668 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.233506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:35.235374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:39.773455 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:39.775089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:39.822970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:39.823258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:39.823837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:39.823837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:39.823837 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:39.823837 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:39.823837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:39.823837 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:39.823837 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:39.823837 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:39.824809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:39.825665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:40.176337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:40.177431 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:40.177702 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:40.177866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.178874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:40.178874 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.178874 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:40.178874 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.178874 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.178874 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:40.178874 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.178874 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:40.179975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.180300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:40.216192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:40.216764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:40.217222 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:40.217400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.217877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:40.217877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.217877 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:40.217877 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.217877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.217877 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:40.217877 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.217877 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:40.218602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:40.219308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:40.219308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.219308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:40.219308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.219308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.219308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:40.219308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.219308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:40.219675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.220358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.221105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:40.221105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.221105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:40.224470 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:40.225281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:40.225881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:40.226179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.226885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:40.226885 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.226885 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:40.226885 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.226885 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.226885 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:40.226885 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.226885 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:40.227820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.228365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:40.229100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.229982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:40.230429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.230429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:40.231424 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:40.231980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:40.232385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:40.232714 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:40.232876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.234865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:40.234865 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.234865 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:40.234865 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.234865 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.234865 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:40.234865 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.234865 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.235718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:40.236278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:44.774019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:44.775159 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:44.809902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:44.810191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:44.810928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:44.810928 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:44.810928 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:44.810928 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:44.810928 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:44.810928 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:44.810928 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:44.810928 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:44.812125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:44.813204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:45.177325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:45.179248 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:45.179715 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:45.180249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.181686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:45.181686 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.181686 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:45.181686 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.181686 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.181686 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:45.181686 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.181686 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:45.185028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.186116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:45.217637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:45.217637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:45.218941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:45.218941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.219770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:45.219770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.219770 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:45.219770 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.219770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.219770 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:45.219770 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.219770 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:45.220804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:45.221340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:45.221340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.221340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:45.221340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.221340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.221340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:45.221340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.221340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:45.222227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.222727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.223168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:45.223168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.223168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:45.226507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:45.226908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:45.227696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:45.228059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.229188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:45.229188 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.229188 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:45.229188 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.229188 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.229188 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:45.229188 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.229188 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:45.233222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.234192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:45.234899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.235721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:45.236407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.236407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:45.236407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:45.236407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:45.236407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:45.236407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:45.236721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.237537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:45.237537 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.237537 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:45.237537 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.237537 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.237537 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:45.237537 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.237537 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.238459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:45.239128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:49.774470 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:49.775683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:49.813564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:49.813939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:49.814696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:49.814696 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:49.814696 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:49.814696 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:49.814696 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:49.814696 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:49.814696 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:49.814696 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:49.815552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:49.816055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:50.177944 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:50.178957 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:50.179309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:50.179500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.180397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:50.180397 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.180397 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:50.180397 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.180397 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.180397 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:50.180397 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.180397 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:50.181737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.182295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:50.217769 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:50.217976 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:50.218605 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:50.218854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.219422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:50.219422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.219422 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:50.219422 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.219422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.219422 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:50.219422 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.219422 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:50.220109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:50.220654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:50.220654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.220654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:50.220654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.220654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.220654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:50.220654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.220654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:50.220912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.221373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.221899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:50.221899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.221899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:50.227033 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:50.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:50.227894 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:50.228255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.229774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.230968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:50.231721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.232750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:50.233254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.233254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:50.235191 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:50.235699 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:50.236844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:50.236844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:50.236844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.238418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:50.238418 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.238418 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:50.238418 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.238418 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.238418 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:50.238418 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.238418 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.239462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:50.240370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:54.775202 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:54.777029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:54.814177 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:54.814446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:54.815175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:54.815175 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:54.815175 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:54.815175 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:54.815175 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:54.815175 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:54.815175 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:54.815175 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:54.816349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:54.817317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:55.178704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:55.180760 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:55.180760 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:55.180760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.181546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:27:55.181546 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.181546 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:55.181546 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.181546 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.181546 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:55.181546 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.181546 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:55.182451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.182992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:55.233181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:55.233181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:55.233181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:27:55.234969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:55.234969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.234969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:55.235813 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:55.236016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:55.239221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:55.240071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.240966 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:55.247292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:55.247784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:55.248308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.248931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:55.249374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.249942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.250841 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.251361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:55.252135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:27:59.776018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:27:59.777153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:27:59.813761 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:27:59.814035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:59.814925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:27:59.814925 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:59.814925 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:27:59.814925 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:27:59.814925 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:59.814925 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:27:59.814925 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:59.814925 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:59.816126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:27:59.816526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:00.179502 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:00.180334 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:00.180570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:00.180758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.181525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:00.181525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.181525 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:00.181525 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.181525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.181525 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:00.181525 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.181525 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:00.182888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.183445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:00.233071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:00.233349 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:00.233922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:00.234150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.234484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:00.235305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:00.235668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:00.235668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.235668 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:00.235668 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.235668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.235668 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:00.235668 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.235668 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:00.236555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:00.237161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:00.237733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.238299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.238992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:00.238992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.238992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:00.238992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.238992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:00.239202 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:00.239353 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:00.239555 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:00.239999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.240581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:00.240581 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.240581 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:00.240581 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.240581 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.240581 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:00.240581 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.240581 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:00.241981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.242598 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.243572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.244148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:00.244685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:00.245083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:00.245657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:00.245657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:04.776578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:04.777868 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:04.860594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:04.860888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:04.861570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:04.861570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:04.861570 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:04.861570 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:04.861570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:04.861570 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:04.861570 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:04.861570 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:04.863137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:04.864078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:05.179942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:05.181115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:05.181402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:05.181692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.182584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:05.182584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.182584 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:05.182584 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.182584 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.182584 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:05.182584 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.182584 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:05.183750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.184671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:05.233668 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:05.234303 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:05.234874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:05.235198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.235999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:05.236586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:05.237920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:05.237920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.237920 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:05.237920 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.237920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.237920 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:05.237920 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.237920 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:05.240759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:05.241872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:05.244458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.245132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.245892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:05.245892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.245892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:05.245892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:05.245892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.246105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:05.246105 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.246105 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:05.246105 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.246105 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.246105 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:05.246105 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.246105 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:05.247245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:05.247871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:05.250032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.250866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.251488 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.252254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:05.252961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:09.777168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:09.778857 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:09.815320 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:09.815527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:09.816275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:09.816275 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:09.816275 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:09.816275 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:09.816275 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:09.816275 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:09.816275 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:09.816275 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:09.817813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:09.819036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:10.180840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:10.181865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:10.182092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:10.182249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.183155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:10.183155 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.183155 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:10.183155 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.183155 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.183155 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:10.183155 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.183155 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:10.184542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.185082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:10.234199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:10.234508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:10.235153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:10.235463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.236122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:10.236122 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.236122 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:10.236122 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.236122 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.236122 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:10.236122 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.236122 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:10.237014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.237639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:10.238014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.238561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.239809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:10.239809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.239809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:10.239809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:10.239809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:10.239809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:10.239809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.240053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:10.240053 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.240053 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:10.240053 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.240053 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.240053 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:10.240053 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.240053 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:10.241408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.242394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:10.242746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:10.244344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.244823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.245941 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.247728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:10.248271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:14.777877 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:14.779260 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:14.814534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:14.814891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:14.815668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:14.815668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:14.815668 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:14.815668 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:14.815668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:14.815668 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:14.815668 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:14.815668 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:14.816952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:14.817711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:15.181400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:15.182638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:15.183035 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:15.183305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.184378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:15.184378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.184378 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:15.184378 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.184378 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.184378 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:15.184378 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.184378 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:15.185475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.186073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:15.234817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:15.235190 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:15.235731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:15.236031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.238490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:15.238490 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.238490 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:15.238490 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.238490 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.238490 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:15.238490 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.238490 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:15.239740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.240652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:15.241837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.242453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.243309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:15.243309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.243309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:15.243309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:15.243309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:15.243309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:15.243722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:15.244215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:15.244731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.245848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:15.246202 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:15.246428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.247005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:15.247005 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.247005 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:15.247005 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.247005 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.247005 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:15.247005 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.247005 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:15.248298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.248981 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:15.249784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.250427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:15.251148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:15.251832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:19.778492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:19.780133 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:19.782737 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:28:19.836011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:19.836947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:19.838127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:19.838127 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:19.838127 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:19.838127 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:19.838127 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:19.838127 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:19.838127 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:19.838127 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:19.840423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:19.841177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:20.182182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:20.183226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:20.183595 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:20.183913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.184973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:20.184973 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.184973 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:20.184973 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.184973 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.184973 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:20.184973 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.184973 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:20.187163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.188377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:20.235519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:20.235967 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:20.236474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:20.236726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.237318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:20.237318 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.237318 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:20.237318 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.237318 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.237318 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:20.237318 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.237318 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:20.238245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.239233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:20.239719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.240405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.241272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:20.241272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.241272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:20.242405 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:20.242689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:20.242978 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:20.243233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.243928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:20.244480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:20.244480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.244480 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:20.244480 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.244480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.244480 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:20.244480 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.244480 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:20.245145 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:20.246992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:20.247469 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:20.248452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.249090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.249666 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.250597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:20.251197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:24.779142 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:24.780800 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:24.818492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:24.818492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:24.819080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:24.819080 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:24.819080 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:24.819080 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:24.819080 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:24.819080 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:24.819080 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:24.819080 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:24.820541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:24.821410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:25.182709 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:25.183916 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:25.184186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:25.184427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.185307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:25.185307 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.185307 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:25.185307 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.185307 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.185307 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:25.185307 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.185307 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:25.187229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.187695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:25.236095 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:25.236470 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:25.237257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:25.237558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.238389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:25.238389 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.238389 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:25.238389 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.238389 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.238389 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:25.238389 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.238389 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:25.239402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.240149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:25.240458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.241143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.241887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:25.241887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.241887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:25.242755 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:25.243040 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:25.243375 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:25.243639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.244126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:25.244126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.244126 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:25.244126 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.244126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.244126 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:25.244126 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.244126 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:25.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.245871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:25.246245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.246960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:25.247666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.247666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:25.247666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:25.247666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:25.247666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:25.247666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:25.247666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.249294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:25.249294 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.249294 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:25.249294 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.249294 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.249294 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:25.249294 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.249294 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.250281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:25.250782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:29.779848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:29.781137 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:29.823511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:29.823783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:29.824486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:29.824486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:29.824486 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:29.824486 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:29.824486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:29.824486 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:29.824486 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:29.824486 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:29.825906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:29.827173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:30.183479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:30.184253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:30.184502 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:30.184647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.185268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:30.185268 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.185268 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:30.185268 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.185268 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.185268 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:30.185268 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.185268 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:30.186046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.186520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:30.236646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:30.236929 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:30.237348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:30.237533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.238011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:30.238011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.238011 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:30.238011 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.238011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.238011 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:30.238011 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.238011 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:30.238840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.239338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:30.239914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.240487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.241194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:30.241194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.241194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:30.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:30.243305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:30.243638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:30.244157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.244651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:30.244651 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.244651 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:30.244651 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.244651 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.244651 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:30.244651 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.244651 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:30.245485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.246240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:30.246882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.247911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:30.248500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.248500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:30.248500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:30.248500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:30.248659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:30.249183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:30.249473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.250299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:30.250299 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.250299 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:30.250299 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.250299 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.250299 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:30.250299 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.250299 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.251998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:30.252640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:34.781388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:34.783435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:34.815793 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:34.816183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:34.817122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:34.817122 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:34.817122 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:34.817122 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:34.817122 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:34.817122 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:34.817122 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:34.817122 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:34.818322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:34.818899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:35.184257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:35.185777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:35.186198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:35.186473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.187493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:35.187493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.187493 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:35.187493 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.187493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.187493 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:35.187493 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.187493 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:35.189048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.189743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:35.237281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:35.238060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:35.238846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:35.239162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.240129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:35.240129 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.240129 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:35.240129 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.240129 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.240129 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:35.240129 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.240129 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:35.242024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.243067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:35.244096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.244938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.245747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:35.245747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.245747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:35.245747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:35.245747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:35.245747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:35.246197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.246901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:35.246901 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.246901 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:35.246901 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.246901 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.246901 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:35.246901 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.246901 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:35.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:35.248735 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:35.250537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.251190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.251930 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.252861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:35.253328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:39.782477 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:39.783749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:39.822781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:39.823367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:39.824590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:39.824590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:39.824590 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:39.824590 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:39.824590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:39.824590 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:39.824590 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:39.824590 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:39.825834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:39.826351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:40.185201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:40.186254 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:40.186559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:40.186912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.187971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:40.187971 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.187971 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:40.187971 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.187971 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.187971 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:40.187971 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.187971 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:40.189857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.190881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:40.237948 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:40.238609 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:40.239226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:40.239536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.240629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:40.240629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.240629 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:40.240629 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.240629 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.240629 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:40.240629 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.240629 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:40.242141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.242962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:40.244306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.245089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.245970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:40.245970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.245970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:40.245970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:40.245970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:40.245970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:40.245970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.246705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:40.246705 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.246705 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:40.246705 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.246705 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.246705 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:40.246705 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.246705 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:40.248532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.248991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:40.250447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.250967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:40.251462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.251462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:40.251462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:40.251462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:40.251462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:40.251757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:40.251757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.252409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:40.252409 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.252409 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:40.252409 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.252409 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.252409 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:40.252409 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.252409 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.253364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:40.253850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:44.783152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:44.785200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:44.817898 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:44.818416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:44.819306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:44.819306 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:44.819306 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:44.819306 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:44.819306 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:44.819306 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:44.819306 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:44.819306 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:44.820196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:44.820997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:45.185802 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:45.187316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:45.187690 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:45.187951 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.189016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:45.189016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.189016 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:45.189016 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.189016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.189016 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:45.189016 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.189016 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:45.191056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.191847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:45.238767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:45.239217 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:45.239860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:45.240163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.240781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:45.240781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.240781 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:45.240781 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.240781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.240781 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:45.240781 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.240781 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:45.241629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.242400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:45.242844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.243488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.244234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:45.244234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.244234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:45.245163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:45.245461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:45.246301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:45.246301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.246595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:45.246595 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.246595 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:45.246595 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.246595 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.246595 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:45.246595 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.246595 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:45.247421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:45.248231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:45.248231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.248231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:45.248231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.248231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.248231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:45.248231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.248231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:45.248565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.249325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:45.250200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.250200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:45.250919 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:45.251359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:45.251825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:45.252183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:45.252402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.253297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:45.253297 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.253297 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:45.253297 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.253297 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.253297 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:45.253297 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.253297 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.254940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:45.255413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:49.784072 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:49.785050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:49.825516 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:49.826039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:49.827150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:49.827150 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:49.827150 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:49.827150 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:49.827150 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:49.827150 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:49.827150 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:49.827150 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:49.828351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:49.829665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:50.186511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:50.187635 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:50.187849 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:50.188003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.188626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:50.188626 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.188626 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:50.188626 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.188626 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.188626 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:50.188626 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.188626 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:50.189762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.190538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:50.239378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:50.240021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:50.240575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:50.240893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.241670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:50.241670 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.241670 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:50.241670 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.241670 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.241670 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:50.241670 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.241670 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:50.242970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.244124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:50.244750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.245457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.246454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:50.246454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.246454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:50.246454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:50.246454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:50.246454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:50.246829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.247230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:50.247230 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.247230 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:50.247230 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.247230 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.247230 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:50.247230 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.247230 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:50.248237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:50.248974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:50.248974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.248974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:50.248974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.248974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.248974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:50.248974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.248974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:50.249668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.250472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:50.251370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.251370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:50.251370 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:50.251789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:50.251940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:50.252180 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:50.252385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.253027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:50.253027 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.253027 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:50.253027 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.253027 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.253027 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:50.253027 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.253027 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.253944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:50.254484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:54.784545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:54.785779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:54.821059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:54.821412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:54.822362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:54.822362 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:54.822362 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:54.822362 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:54.822362 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:54.822362 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:54.822362 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:54.822362 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:54.823558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:54.824390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:55.187135 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:55.188515 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:55.188752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:55.189018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.190081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:28:55.190081 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.190081 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:55.190081 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.190081 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.190081 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:55.190081 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.190081 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:55.191843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.192335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:55.239960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:55.240713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:28:55.241341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:55.241746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.242650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:28:55.242650 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.242650 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:55.242650 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.242650 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.242650 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:55.242650 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.242650 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:55.243643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.244399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:28:55.245023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.245893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.246866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:55.246866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.246866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:55.246866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:55.246866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:55.246866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:55.247224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.248143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:28:55.248143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.248143 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:55.248143 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.248143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.248143 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:55.248143 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.248143 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:28:55.249335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:55.249965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:28:55.249965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.249965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:28:55.249965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.249965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.249965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:28:55.249965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.249965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:28:55.251043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.251503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:55.252027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.252027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:55.252027 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:55.252430 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:55.252989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:55.253537 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:55.253851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.254667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:28:55.254667 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.254667 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:55.254667 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.254667 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.254667 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:55.254667 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.254667 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.255846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:55.256320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:28:59.785386 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:28:59.786591 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:28:59.824381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:28:59.824530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:59.825209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:28:59.825209 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:59.825209 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:28:59.825209 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:28:59.825209 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:59.825209 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:28:59.825209 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:59.825209 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:59.827919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:28:59.828721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:00.187958 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:00.189251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:00.189918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:00.189918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.190912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:00.190912 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.190912 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:00.190912 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.190912 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.190912 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:00.190912 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.190912 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:00.192691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.193417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:00.240542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:00.240910 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:00.241542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:00.241889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.245288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.246135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:00.247397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.248745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.250835 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:00.251972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:00.253181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:00.259580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:00.260680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:00.261659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:00.262109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:00.262691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:04.785995 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:04.787353 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:04.827388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:04.827686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:04.828751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:04.828751 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:04.828751 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:04.828751 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:04.828751 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:04.828751 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:04.828751 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:04.828751 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:04.830338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:04.831143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:05.188761 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:05.189810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:05.190188 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:05.190498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.191492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:05.191492 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.191492 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:05.191492 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.191492 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.191492 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:05.191492 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.191492 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:05.193274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.194364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:05.241177 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:05.241834 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:05.242308 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:05.242523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.243187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:05.243187 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.243187 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:05.243187 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.243187 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.243187 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:05.243187 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.243187 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:05.244883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.245833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:05.246512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.247157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.247738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:05.247738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.247738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:05.247738 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:05.247738 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:05.247972 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:05.248422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.249321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:05.249321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.249321 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:05.249321 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.249321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.249321 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:05.249321 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.249321 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:05.250270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:05.250846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:05.250846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.250846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:05.250846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.250846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.250846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:05.250846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.250846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:05.251809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.252320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:05.252873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.252873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:05.252873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:05.253227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:05.253603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:05.253907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:05.254097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.254641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:05.254641 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.254641 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:05.254641 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.254641 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.254641 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:05.254641 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.254641 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.255729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:05.256205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:09.786513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:09.788067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:09.825803 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:09.826235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:09.827216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:09.827216 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:09.827216 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:09.827216 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:09.827216 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:09.827216 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:09.827216 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:09.827216 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:09.828184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:09.829132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:10.189346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:10.190839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:10.191310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:10.191941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.192971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:10.192971 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.192971 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:10.192971 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.192971 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.192971 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:10.192971 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.192971 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:10.194149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.194974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:10.241898 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:10.242347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:10.243015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:10.243327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.244164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:10.244164 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.244164 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:10.244164 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.244164 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.244164 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:10.244164 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.244164 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:10.245399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.246314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:10.247395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.248573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.249721 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:10.251471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:10.252397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:10.253321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:10.254259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:10.255112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:10.255112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:10.255112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.255524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:10.255524 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.255524 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:10.255524 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.255524 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.255524 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:10.255524 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.255524 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.256525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:10.256937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:14.787238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:14.789376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:14.827482 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:14.827955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:14.828849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:14.828849 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:14.828849 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:14.828849 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:14.828849 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:14.828849 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:14.828849 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:14.828849 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:14.829734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:14.830666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:15.189989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:15.191341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:15.191684 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:15.192449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.192903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:15.192903 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.192903 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:15.192903 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.192903 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.192903 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:15.192903 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.192903 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:15.194756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.195526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:15.243829 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:15.244085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:15.245006 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:15.246060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.247656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:15.247656 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.247656 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:15.247656 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.247656 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.247656 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:15.247656 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.247656 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:15.249284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.249857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:15.250231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.251302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:15.251302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.251302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:15.251302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:15.251302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:15.251552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:15.251932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.252690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:15.252690 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.252690 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:15.252690 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.252690 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.252690 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:15.252690 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.252690 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:15.253646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.254393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:15.255020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.255521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:15.256296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.256296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:15.256296 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:15.256296 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:15.256296 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:15.256588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:15.256823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.257571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:15.257571 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.257571 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:15.257571 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.257571 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.257571 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:15.257571 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.257571 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.258905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:15.259376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:19.787836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:19.789398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:19.791448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:29:19.823764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:19.824106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:19.824940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:19.824940 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:19.824940 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:19.824940 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:19.824940 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:19.824940 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:19.824940 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:19.824940 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:19.826012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:19.826519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:20.190772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:20.191706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:20.192100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:20.192391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.193283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:20.193283 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.193283 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:20.193283 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.193283 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.193283 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:20.193283 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.193283 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:20.194356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.195160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:20.243836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:20.244332 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:20.244994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:20.245342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.246157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:20.246157 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.246157 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:20.246157 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.246157 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.246157 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:20.246157 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.246157 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:20.247039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:20.247561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:20.247561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.247561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:20.247561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.247561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.247561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:20.247561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.247561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:20.248171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.248626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.249100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:20.249100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.249100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:20.250914 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:20.251341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:20.251883 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:20.252283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.253348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:20.253348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.253348 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:20.253348 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.253348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.253348 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:20.253348 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.253348 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:20.254811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.255663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:20.256774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:20.258105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.258105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:20.258105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:20.258105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:20.258105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:20.258445 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:20.258743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.259555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:20.259555 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.259555 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:20.259555 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.259555 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.259555 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:20.259555 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.259555 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.260844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:20.261358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:24.788687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:24.790571 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:24.822539 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:24.823015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:24.823749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:24.823749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:24.823749 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:24.823749 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:24.823749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:24.823749 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:24.823749 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:24.823749 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:24.824506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:24.825357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:25.191523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:25.192721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:25.193075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:25.193369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.194265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:25.194265 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.194265 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:25.194265 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.194265 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.194265 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:25.194265 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.194265 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:25.195548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.196365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:25.244569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:25.245049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:25.245795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:25.246111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.247025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:25.247025 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.247025 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:25.247025 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.247025 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.247025 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:25.247025 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.247025 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:25.248551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:25.249130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:25.249130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.249130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:25.249130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.249130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.249130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:25.249130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.249130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:25.250162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.251203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.252340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:25.252340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.252340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:25.252340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:25.252340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:25.252340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:25.252818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.253845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:25.253845 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.253845 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:25.253845 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.253845 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.253845 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:25.253845 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.253845 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:25.254334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.254763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:25.255076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.255500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:25.256131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.256131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:25.257870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:25.259059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:25.259585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:25.259914 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:25.260289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.261051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:25.261051 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.261051 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:25.261051 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.261051 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.261051 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:25.261051 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.261051 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.262320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:25.262972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:29.789432 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:29.790996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:29.827401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:29.827687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:29.828062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:29.828062 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:29.828062 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:29.828062 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:29.828062 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:29.828062 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:29.828062 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:29.828062 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:29.828926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:29.829826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:30.192319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:30.193929 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:30.194366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:30.194644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.195846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:30.195846 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.195846 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:30.195846 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.195846 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.195846 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:30.195846 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.195846 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:30.198213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.198672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:30.245285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:30.246472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:30.246905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:30.247149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.247782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:30.247782 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.247782 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:30.247782 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.247782 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.247782 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:30.247782 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.247782 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:30.248754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:30.249581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:30.249581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.249581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:30.249581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.249581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.249581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:30.249581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.249581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:30.250117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.250753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.251380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:30.251380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.251380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:30.252039 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:30.252811 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:30.253259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:30.253880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.254139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:30.254139 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.254139 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:30.254139 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.254139 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.254139 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:30.254139 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.254139 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:30.255241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.255770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:30.256635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.257147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:30.257743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.257743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:30.258290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:30.258973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:30.259636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:30.259841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:30.259841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.260522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:30.260522 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.260522 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:30.260522 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.260522 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.260522 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:30.260522 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.260522 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.261989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:30.262596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:34.790157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:34.791173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:34.818746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:34.818976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:34.820543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:34.820543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:34.820543 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:34.820543 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:34.820543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:34.820543 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:34.820543 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:34.820543 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:34.821215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:34.822126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:35.192813 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:35.194531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:35.195054 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:35.195449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.196770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:35.196770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.196770 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:35.196770 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.196770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.196770 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:35.196770 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.196770 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:35.198400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.199075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:35.246360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:35.246940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:35.247712 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:35.248129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.249408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:35.249408 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.249408 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:35.249408 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.249408 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.249408 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:35.249408 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.249408 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:35.250883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:35.251449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:35.251449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.251449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:35.251449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.251449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.251449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:35.251449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.251449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:35.252885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.253471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.254066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:35.254066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.254066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:35.254066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:35.254066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:35.254500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:35.254830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.255519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:35.255519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.255519 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:35.255519 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.255519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.255519 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:35.255519 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.255519 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:35.257080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.257528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:35.259151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.259977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:35.261153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.261153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:35.261153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:35.261153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:35.261153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:35.261153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:35.261153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.262431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:35.262431 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.262431 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:35.262431 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.262431 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.262431 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:35.262431 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.262431 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.263035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:35.263548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:39.790820 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:39.792275 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:39.831514 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:39.831956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:39.832966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:39.832966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:39.832966 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:39.832966 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:39.832966 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:39.832966 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:39.832966 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:39.832966 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:39.834357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:39.835287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:40.193898 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:40.195149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:40.195465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:40.195776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.196599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:40.196599 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.196599 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:40.196599 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.196599 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.196599 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:40.196599 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.196599 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:40.197859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.198973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:40.247020 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:40.247388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:40.248274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:40.248661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.249657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:40.249657 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.249657 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:40.249657 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.249657 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.249657 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:40.249657 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.249657 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:40.250774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:40.251575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:40.251575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.251575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:40.251575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.251575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.251575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:40.251575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.251575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:40.252262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.253004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.254009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:40.254009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.254009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:40.254009 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:40.254351 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:40.255095 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:40.255595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.256855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:40.256855 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.256855 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:40.256855 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.256855 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.256855 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:40.256855 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.256855 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:40.258050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.259099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:40.259742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.260476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:40.261045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.261045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:40.261045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:40.261045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:40.261352 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:40.261669 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:40.261836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.262268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:40.262268 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.262268 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:40.262268 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.262268 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.262268 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:40.262268 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.262268 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.263335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:40.263695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:44.791413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:44.792502 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:44.824845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:44.825183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:44.826003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:44.826003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:44.826003 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:44.826003 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:44.826003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:44.826003 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:44.826003 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:44.826003 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:44.826990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:44.827692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:45.194432 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:45.195605 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:45.196027 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:45.196405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.197543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:45.197543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.197543 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:45.197543 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.197543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.197543 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:45.197543 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.197543 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:45.199683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.200669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:45.247534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:45.247761 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:45.248203 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:45.248433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.249036 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:45.249036 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.249036 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:45.249036 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.249036 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.249036 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:45.249036 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.249036 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:45.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:45.250334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:45.250334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.250334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:45.250334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.250334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.250334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:45.250334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.250334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:45.250823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.251314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.251927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:45.251927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.251927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:45.254116 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:45.254734 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:45.255069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:45.255311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.255871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:45.255871 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.255871 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:45.255871 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.255871 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.255871 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:45.255871 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.255871 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:45.256646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:45.257651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:45.258361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.259308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:45.261067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:45.261490 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:45.262756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:45.262756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:45.262756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.263158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:45.263158 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.263158 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:45.263158 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.263158 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.263158 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:45.263158 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.263158 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.264706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:45.265341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:49.791966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:49.793702 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:49.831404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:49.831960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:49.832749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:49.832749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:49.832749 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:49.832749 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:49.832749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:49.832749 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:49.832749 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:49.832749 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:49.833982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:49.835718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:50.195137 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:50.196028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:50.196257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:50.196419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.197106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:50.197106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.197106 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:50.197106 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.197106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.197106 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:50.197106 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.197106 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:50.198401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.199528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:50.248131 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:50.248975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:50.249958 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:50.250242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.251140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:50.251140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.251140 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:50.251140 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.251140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.251140 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:50.251140 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.251140 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:50.252719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:50.253804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:50.253804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.253804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:50.253804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.253804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.253804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:50.253804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.253804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:50.254503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.255270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.256062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:50.256062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.256062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:50.256062 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:50.256062 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:50.256326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:50.256942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.257992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:50.257992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.257992 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:50.257992 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.257992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.257992 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:50.257992 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.257992 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:50.258864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:50.259529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:50.259529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.259529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:50.259529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.259529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.259529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:50.259529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.259529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:50.260031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.260774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:50.261510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.261510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:50.261606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:50.262241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:50.262517 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:50.262770 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:50.262966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.263464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:50.263464 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.263464 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:50.263464 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.263464 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.263464 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:50.263464 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.263464 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.264704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:50.265199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:54.792785 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:54.794656 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:54.833678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:54.834149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:54.835076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:54.835076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:54.835076 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:54.835076 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:54.835076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:54.835076 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:54.835076 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:54.835076 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:54.835839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:54.836677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:55.195717 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:55.197238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:55.197512 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:55.197814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.198698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:29:55.198698 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.198698 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:55.198698 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.198698 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.198698 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:55.198698 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.198698 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:55.200093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.200654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:55.248739 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:55.249245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:29:55.249906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:55.250239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.251053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:29:55.251053 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.251053 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:55.251053 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.251053 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.251053 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:55.251053 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.251053 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:55.252269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:55.252908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:55.252908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.252908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:55.252908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.252908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.252908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:55.252908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.252908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:29:55.253968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.255016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:55.255016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.255016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:55.255478 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:55.256003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:55.256459 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:55.256714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.257192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:29:55.257192 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.257192 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:55.257192 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.257192 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.257192 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:55.257192 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.257192 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:29:55.258413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.259032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:29:55.259602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.260247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:55.260989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.260989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:55.262136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:55.262844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:55.263189 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:55.263409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:55.263582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.264180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:29:55.264180 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.264180 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:55.264180 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.264180 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.264180 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:55.264180 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.264180 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.265997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:55.266520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:29:59.793562 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:29:59.795458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:29:59.832970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:29:59.833537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:59.834798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:29:59.834798 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:59.834798 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:29:59.834798 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:29:59.834798 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:59.834798 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:29:59.834798 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:59.834798 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:59.835882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:29:59.837003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:00.196439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:00.197695 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:00.197973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:00.198185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.199059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:00.199059 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.199059 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:00.199059 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.199059 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.199059 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:00.199059 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.199059 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:00.201400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.201902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:00.249305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:00.249815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:00.250405 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:00.250830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.251588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:00.251588 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.251588 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:00.251588 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.251588 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.251588 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:00.251588 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.251588 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:00.252763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:00.253577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:00.253577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.253577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:00.253577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.253577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.253577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:00.253577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.253577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:00.254261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.255038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.255827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:00.255827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.255827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:00.256150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:00.256811 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:00.257285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:00.257712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.258501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:00.258501 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.258501 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:00.258501 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.258501 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.258501 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:00.258501 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.258501 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:00.259507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.260376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:00.260857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.261683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:00.262731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.262731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:00.262859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:00.263815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:00.264199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:00.264444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:00.264666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.265254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:00.265254 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.265254 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:00.265254 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.265254 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.265254 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:00.265254 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.265254 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.266711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:00.267194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:04.794315 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:04.796244 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:04.833233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:04.833900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:04.834482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:04.834482 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:04.834482 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:04.834482 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:04.834482 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:04.834482 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:04.834482 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:04.834482 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:04.835697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:04.836346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:05.197251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:05.198437 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:05.198805 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:05.199062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.200304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:05.200304 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.200304 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:05.200304 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.200304 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.200304 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:05.200304 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.200304 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:05.202318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.203137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:05.249918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:05.250395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:05.251027 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:05.251247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.251886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:05.251886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.251886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:05.251886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.251886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.251886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:05.251886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.251886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:05.253271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:05.253986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:05.253986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.253986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:05.253986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.253986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.253986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:05.253986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.253986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:05.254378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.254857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.255383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:05.255383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.255383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:05.256830 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:05.257359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:05.257836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:05.258127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.258883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:05.258883 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.258883 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:05.258883 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.258883 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.258883 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:05.258883 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.258883 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:05.259930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.260392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:05.261056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.261519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:05.262055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.262055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:05.263312 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:05.264134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:05.264498 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:05.264792 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:05.264994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.265778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:05.265778 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.265778 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:05.265778 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.265778 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.265778 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:05.265778 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.265778 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.267636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:05.268374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:09.795090 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:09.796790 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:09.839213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:09.839456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:09.840086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:09.840086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:09.840086 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:09.840086 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:09.840086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:09.840086 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:09.840086 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:09.840086 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:09.841258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:09.842277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:10.197791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:10.198890 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:10.199149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:10.199881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.200191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:10.200191 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.200191 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:10.200191 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.200191 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.200191 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:10.200191 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.200191 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:10.201451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.202374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:10.250564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:10.250786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:10.251460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:10.251801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.252518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:10.252518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.252518 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:10.252518 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.252518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.252518 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:10.252518 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.252518 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:10.253255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:10.253803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:10.253803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.253803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:10.253803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.253803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.253803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:10.253803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.253803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:10.254040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.254465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.255003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:10.255003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.255003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:10.257162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:10.257879 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:10.258210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:10.258923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.259115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:10.259115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.259115 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:10.259115 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.259115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.259115 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:10.259115 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.259115 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:10.261298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.262038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:10.262896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.263369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:10.263890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.263890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:10.263890 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:10.264387 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:10.264859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:10.265130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:10.265284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.265938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:10.265938 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.265938 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:10.265938 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.265938 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.265938 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:10.265938 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.265938 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:10.267465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:14.795872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:14.796795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:14.840854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:14.841039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:14.841505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:14.841505 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:14.841505 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:14.841505 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:14.841505 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:14.841505 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:14.841505 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:14.841505 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:14.842285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:14.842887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:15.198642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:15.200075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:15.200473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:15.200566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.201292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:15.201292 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.201292 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:15.201292 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.201292 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.201292 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:15.201292 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.201292 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:15.202802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.203646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:15.251427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:15.252130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:15.252788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:15.253499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.254416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:15.254416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.254416 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:15.254416 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.254416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.254416 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:15.254416 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.254416 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:15.255450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:15.255993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:15.255993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.255993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:15.255993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.255993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.255993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:15.255993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.255993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:15.257728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.258916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.259682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:15.259682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.259682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:15.259682 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:15.259682 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:15.260354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:15.260486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.261386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:15.261386 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.261386 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:15.261386 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.261386 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.261386 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:15.261386 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.261386 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:15.262396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.263110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:15.263776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.264320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:15.264921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.264921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:15.264921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:15.265059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:15.265483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:15.265778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:15.265936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.266659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:15.266659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.266659 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:15.266659 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.266659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.266659 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:15.266659 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.266659 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.268560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:15.269130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:19.796482 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:19.798397 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:19.800400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:30:19.833102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:19.833318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:19.834098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:19.834098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:19.834098 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:19.834098 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:19.834098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:19.834098 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:19.834098 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:19.834098 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:19.835584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:19.836167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:20.199468 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:20.200714 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:20.200953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:20.201111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.201829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:20.201829 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.201829 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:20.201829 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.201829 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.201829 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:20.201829 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.201829 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:20.203019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.204169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:20.252174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:20.252507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:20.253162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:20.253457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.254246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:20.254246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.254246 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:20.254246 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.254246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.254246 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:20.254246 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.254246 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:20.255917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:20.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:20.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:20.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:20.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:20.257136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.257724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.258365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:20.258365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.258365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:20.258995 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:20.259561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:20.260091 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:20.260328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.261016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:20.261016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.261016 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:20.261016 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.261016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.261016 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:20.261016 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.261016 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:20.261931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.262681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:20.263132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.263793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:20.264352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.264352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:20.264846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:20.265541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:20.265868 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:20.266087 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:20.266253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.267096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:20.267096 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.267096 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:20.267096 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.267096 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.267096 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:20.267096 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.267096 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.268330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:20.269192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:23.318122 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:23.328134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 08 13:30:23.328285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104932) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 08 13:30:23.328595 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:30:23.369240 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, resource={'id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'name': 'private', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['b9c480ba-80ab-475b-b935-84420037c6ca', 'd4905e6d-9f85-4996-afec-3692c12d93d1'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:10:08Z', 'updated_at': '2026-04-08T13:10:12Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21658}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.369688 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.370231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c9a391e0-7fa7-4719-b96c-81fc2e60a06f, external_ids_update=None, columns={'tag': 21658}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.370448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.371298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:23.371298 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.371298 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:23.371298 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.371298 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.371298 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:23.371298 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.371298 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.372481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.373378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.374062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:30:23.374062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.374062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:30:23.374062 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:30:23.399963 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, resource={'id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'name': 'public', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['88cc7e33-1b68-4e35-9edc-36247de507c0', 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-08T13:10:14Z', 'updated_at': '2026-04-08T13:10:22Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.400336 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.400955 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-83258353-9720-4502-8be2-b82538bb4ee2, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.401267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.402078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:23.402078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.402078 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:23.402078 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.402078 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.402078 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:23.402078 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.402078 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.403548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.403943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:30:23.403943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.403943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:30:23.403943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:30:23.432169 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, resource={'id': 'a5d505fb-12e2-4aed-8078-02b88b929c5e', 'name': 'admin_net', 'tenant_id': '98be377457d344c7834b290dc92d0dda', 'project_id': '98be377457d344c7834b290dc92d0dda', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['39438f35-bd24-4a86-8cab-99f980e8887d'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:05Z', 'updated_at': '2026-04-08T13:14:07Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 13489}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.432515 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.433059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-daf5372b-8660-44b8-b300-e46a7451059b, external_ids_update=None, columns={'tag': 13489}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.433217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.433977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:23.433977 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.433977 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:23.433977 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.433977 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.433977 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:23.433977 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.433977 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.435139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.435737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.436297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:30:23.436297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.436297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:30:23.436297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:30:23.465380 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-daec8bf3-7182-4be9-bfe4-655236471090, resource={'id': 'daec8bf3-7182-4be9-bfe4-655236471090', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['28da0a33-78ce-48f8-89df-3533da3ec3de'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:49Z', 'updated_at': '2026-04-08T13:14:49Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 54317}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.465781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-daec8bf3-7182-4be9-bfe4-655236471090, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.466281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-4b03e103-5c09-4760-adf8-c6bbd598718a, external_ids_update=None, columns={'tag': 54317}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.466527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.467257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:23.467257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.467257 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:23.467257 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.467257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.467257 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:23.467257 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.467257 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.468379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.469005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.469660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:30:23.469660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.469660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:30:23.469660 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:30:23.715315 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, resource={'id': '71709845-924e-42fd-985e-d000e2c61286', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'enable_snat': True}, 'gw_port_id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-az3g9', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'ip_address': '172.24.5.223', 'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'}, {'ip_address': '2001:db8::19', 'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 3, 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985'}, resource_type=routers, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.715754 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.716109 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.716337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.716566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.717523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:23.717523 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.717523 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:23.717523 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.717523 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.717523 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:23.717523 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.717523 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:23.718062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Unable to update router 71709845-924e-42fd-985e-d000e2c61286. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 08 13:30:23.719475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:30:23.720249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:30:23.720959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:30:23.819110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, resource={'id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'name': '', 'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'project_id': '', 'mac_address': 'fa:16:3e:d4:5c:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71709845-924e-42fd-985e-d000e2c61286', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164309', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.819414 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5 88cc7e33-1b68-4e35-9edc-36247de507c0', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-71709845-924e-42fd-985e-d000e2c61286'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.223/24', '2001:db8::19/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.819714 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=59fc94c5-b567-475a-b3a9-f77ef27251c0, lrouter_port=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:23.820048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.820879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:23.820879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.820879 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:23.820879 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.820879 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.820879 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:23.820879 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.820879 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.822124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:30:23.822853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:23.823522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:30:23.823522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:23.823522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:30:23.823522 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Synchronization completed (took 0.49 seconds)
Apr 08 13:30:24.797419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:24.799210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:24.837810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:24.838227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:24.839266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:24.839266 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:24.839266 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:24.839266 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:24.839266 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:24.839266 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:24.839266 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:24.839266 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:24.840235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:24.841167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:25.200288 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:25.201658 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:25.202559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:25.202559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.203041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:25.203041 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.203041 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:25.203041 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.203041 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.203041 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:25.203041 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.203041 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:25.204162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.205100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:25.252694 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:25.253179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:25.253985 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:25.254434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.255321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:25.255321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.255321 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:25.255321 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.255321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.255321 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:25.255321 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.255321 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:25.256318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:25.256961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:25.256961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.256961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:25.256961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.256961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.256961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:25.256961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.256961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:25.257402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.258021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.258677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:25.258677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.258677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:25.259552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:25.259986 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:25.260562 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:25.261133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.262117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:25.262117 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.262117 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:25.262117 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.262117 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.262117 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:25.262117 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.262117 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:25.262894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.263491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:25.263983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.264539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:25.265132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.265132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:25.265265 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:25.266181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:25.266562 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:25.266804 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:25.266956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.267436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:25.267436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.267436 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:25.267436 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.267436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.267436 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:25.267436 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.267436 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.268867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:25.269373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:29.797894 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:29.799085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:29.832860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:29.833447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:29.834499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:29.834499 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:29.834499 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:29.834499 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:29.834499 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:29.834499 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:29.834499 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:29.834499 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:29.835762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:29.836289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:30.201017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:30.202442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:30.202852 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:30.203135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.204441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:30.204441 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.204441 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:30.204441 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.204441 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.204441 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:30.204441 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.204441 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:30.206097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.207453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:30.253323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:30.253862 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:30.254629 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:30.254986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.255808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:30.255808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.255808 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:30.255808 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.255808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.255808 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:30.255808 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.255808 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:30.257171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:30.258093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:30.258093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.258093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:30.258093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.258093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.258093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:30.258093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.258093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:30.258818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.259653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.260592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:30.260592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.260592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:30.260592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:30.260956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:30.261460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:30.261833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.262649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:30.262649 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.262649 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:30.262649 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.262649 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.262649 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:30.262649 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.262649 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:30.264347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.265368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:30.266881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.268341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:30.269179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.269179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:30.269179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:30.269179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:30.269179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:30.269179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:30.269524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.270015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:30.270015 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.270015 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:30.270015 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.270015 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.270015 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:30.270015 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.270015 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.271022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:30.271880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:34.798507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:34.799484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:34.822398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:34.822911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:34.823810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:34.823810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:34.823810 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:34.823810 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:34.823810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:34.823810 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:34.823810 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:34.823810 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:34.824741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:34.825599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:35.201752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:35.202960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:35.203221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:35.203432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.204237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:35.204237 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.204237 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:35.204237 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.204237 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.204237 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:35.204237 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.204237 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:35.205903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.206756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:35.253834 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:35.254271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:35.255218 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:35.255319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.256055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:35.256055 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.256055 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:35.256055 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.256055 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.256055 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:35.256055 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.256055 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:35.256929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:35.257706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:35.257706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.257706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:35.257706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.257706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.257706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:35.257706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.257706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:35.258119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.258880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.259649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:35.259649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.259649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:35.260730 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:35.261383 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:35.262079 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:35.262449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.263364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:35.263364 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.263364 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:35.263364 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.263364 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.263364 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:35.263364 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.263364 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:35.265017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.265417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:35.266811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.267245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:35.267873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.267873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:35.268010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:35.268401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:35.268828 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:35.269060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:35.269212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.269743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:35.269743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.269743 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:35.269743 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.269743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.269743 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:35.269743 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.269743 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.271029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:35.271469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:39.799056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:39.800276 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:39.832285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:39.832713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:39.833636 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:39.833636 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:39.833636 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:39.833636 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:39.833636 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:39.833636 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:39.833636 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:39.833636 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:39.834848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:39.835715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:40.202416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:40.203844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:40.204163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:40.204442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.205314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:40.205314 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.205314 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:40.205314 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.205314 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.205314 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:40.205314 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.205314 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:40.206557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.207376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:40.254416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:40.255005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:40.255688 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:40.256027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.256975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:40.256975 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.256975 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:40.256975 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.256975 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.256975 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:40.256975 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.256975 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:40.258064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.259141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:40.259887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.260722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:40.261341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:40.262005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:40.262632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:40.263002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.263862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:40.263862 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.263862 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:40.263862 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.263862 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.263862 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:40.263862 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.263862 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:40.265529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.265973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:40.267471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.267973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:40.268465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.268465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:40.268465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:40.268668 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:40.269076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:40.269440 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:40.269729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.270686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:40.270686 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.270686 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:40.270686 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.270686 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.270686 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:40.270686 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.270686 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.272023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:40.272513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:44.799947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:44.801390 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:44.837939 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:44.838441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:44.839550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:44.839550 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:44.839550 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:44.839550 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:44.839550 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:44.839550 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:44.839550 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:44.839550 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:44.840895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:44.841608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:45.203317 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:45.205388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:45.205548 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:45.205912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.207400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:45.207400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.207400 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:45.207400 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.207400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.207400 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:45.207400 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.207400 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:45.208808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.209867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:45.255245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:45.255848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:45.256346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:45.256562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.257173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:45.257173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.257173 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:45.257173 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.257173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.257173 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:45.257173 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.257173 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:45.258495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:45.259479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:45.259479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.259479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:45.259479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.259479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.259479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:45.259479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.259479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:45.259995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.260829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.261923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:45.261923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.261923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:45.262463 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:45.263024 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:45.263351 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:45.263574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.264137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:45.264137 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.264137 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:45.264137 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.264137 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.264137 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:45.264137 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.264137 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:45.264975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.265874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:45.266314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.267112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:45.267959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.267959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:45.268796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:45.269356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:45.269934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:45.270135 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:45.270297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.270930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:45.270930 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.270930 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:45.270930 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.270930 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.270930 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:45.270930 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.270930 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.272775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:45.273256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:49.800465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:49.801982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:49.843778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:49.844337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:49.845511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:49.845511 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:49.845511 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:49.845511 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:49.845511 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:49.845511 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:49.845511 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:49.845511 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:49.847348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:49.848338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:50.204167 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:50.205509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:50.205971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:50.206341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.207919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:50.207919 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.207919 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:50.207919 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.207919 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.207919 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:50.207919 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.207919 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:50.209656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.210533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:50.255850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:50.256098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:50.256676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:50.256921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.257481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:50.257481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.257481 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:50.257481 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.257481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.257481 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:50.257481 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.257481 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:50.258767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:50.259291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:50.259291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.259291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:50.259291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.259291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.259291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:50.259291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.259291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:50.260181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.260965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.262030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:50.262030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.262030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:50.262922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:50.263421 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:50.263860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:50.264144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.264865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:50.264865 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.264865 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:50.264865 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.264865 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.264865 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:50.264865 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.264865 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:50.266075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.266501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:50.267665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:50.268758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.268758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:50.269123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:50.269691 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:50.270077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:50.270298 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:50.270454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.271100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:50.271100 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.271100 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:50.271100 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.271100 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.271100 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:50.271100 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.271100 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.272335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:50.272931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:54.801072 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:54.802643 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:54.838261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:54.838553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:54.839510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:54.839510 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:54.839510 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:54.839510 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:54.839510 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:54.839510 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:54.839510 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:54.839510 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:54.840459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:54.841117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:55.204906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:55.206322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:55.206687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:55.206952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.208095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:30:55.208095 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.208095 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:55.208095 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.208095 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.208095 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:55.208095 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.208095 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:55.210775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.211570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:55.256492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:55.257359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:30:55.258150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:55.258521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.259460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:30:55.259460 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.259460 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:55.259460 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.259460 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.259460 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:55.259460 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.259460 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:55.260809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:55.261668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:55.261668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.261668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:55.261668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.261668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.261668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:55.261668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.261668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:30:55.262508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.263085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.263603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:55.263603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.263603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:55.263603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:55.264289 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:55.264964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:55.265599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.266346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:30:55.266346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.266346 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:55.266346 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.266346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.266346 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:55.266346 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.266346 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:30:55.267894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.268309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:30:55.269874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.270318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:55.270832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.270832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:55.270832 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:55.271082 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:55.271674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:55.272085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:55.272353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.273525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:30:55.273525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.273525 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:55.273525 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.273525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.273525 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:55.273525 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.273525 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.275412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:55.275957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:30:59.801712 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:30:59.803192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:30:59.836962 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:30:59.837424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:59.838543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:30:59.838543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:59.838543 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:30:59.838543 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:30:59.838543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:59.838543 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:30:59.838543 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:59.838543 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:59.839648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:30:59.840682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:00.206064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:00.206903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:00.207235 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:00.207520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.209222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:00.209222 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.209222 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:00.209222 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.209222 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.209222 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:00.209222 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.209222 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:00.210743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.211637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:00.257460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:00.257826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:00.258981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:00.259307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.260105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:00.260105 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.260105 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:00.260105 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.260105 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.260105 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:00.260105 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.260105 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:00.261402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:00.262307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:00.262307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.262307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:00.262307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.262307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.262307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:00.262307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.262307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:00.263064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.263873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.264789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:00.264789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.264789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:00.264789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:00.264789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:00.265078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:00.265151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.265707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:00.265707 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.265707 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:00.265707 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.265707 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.265707 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:00.265707 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.265707 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:00.266574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.267311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:00.268006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.268908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:00.269819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.269819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:00.270802 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:00.271389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:00.271716 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:00.271932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:00.272082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.272648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:00.272648 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.272648 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:00.272648 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.272648 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.272648 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:00.272648 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.272648 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.274283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:00.274804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:04.802415 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:04.803891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:04.837999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:04.838192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:04.838791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:04.838791 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:04.838791 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:04.838791 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:04.838791 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:04.838791 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:04.838791 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:04.838791 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:04.839949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:04.840735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:05.206227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:05.207815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:05.208177 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:05.208423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.209481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:05.209481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.209481 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:05.209481 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.209481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.209481 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:05.209481 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.209481 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:05.211683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.212497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:05.258164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:05.258575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:05.259169 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:05.259398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.260238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:05.260238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.260238 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:05.260238 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.260238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.260238 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:05.260238 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.260238 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:05.261564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:05.262359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:05.262359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.262359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:05.262359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.262359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.262359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:05.262359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.262359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:05.263327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.264050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.264764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:05.264764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.264764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:05.264764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:05.264764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:05.265059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:05.265279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.265758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:05.265758 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.265758 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:05.265758 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.265758 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.265758 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:05.265758 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.265758 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:05.266489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.267220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:05.267737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.268278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:05.268848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.268848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:05.271317 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:05.271705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:05.272024 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:05.272242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:05.272376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.272860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:05.272860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.272860 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:05.272860 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.272860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.272860 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:05.272860 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.272860 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.273997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:05.274483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:09.803073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:09.804669 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:09.838760 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:09.839008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:09.839604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:09.839604 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:09.839604 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:09.839604 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:09.839604 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:09.839604 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:09.839604 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:09.839604 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:09.840716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:09.841754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:10.207012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:10.208424 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:10.208939 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:10.209339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.210519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:10.210519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.210519 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:10.210519 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.210519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.210519 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:10.210519 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.210519 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:10.211723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.212432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:10.258907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:10.259667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:10.260761 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:10.261607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.262181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:10.262181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.262181 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:10.262181 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.262181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.262181 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:10.262181 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.262181 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:10.263726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:10.264667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:10.264667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.264667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:10.264667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.264667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.264667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:10.264667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.264667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:10.265418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.266180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.267113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:10.267113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.267113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:10.267113 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:10.267113 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:10.267113 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:10.267113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.268466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:10.268466 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.268466 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:10.268466 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.268466 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.268466 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:10.268466 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.268466 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:10.269377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.269870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:10.271404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.271976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:10.272536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.272536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:10.272536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:10.272536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:10.272708 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:10.273084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:10.273415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.274112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:10.274112 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.274112 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:10.274112 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.274112 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.274112 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:10.274112 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.274112 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.275278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:10.275849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:14.803829 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:14.805697 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:14.840236 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:14.840600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:14.841546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:14.841546 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:14.841546 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:14.841546 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:14.841546 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:14.841546 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:14.841546 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:14.841546 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:14.842818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:14.843379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:15.207609 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:15.208850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:15.209252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:15.209506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.210553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:15.210553 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.210553 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:15.210553 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.210553 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.210553 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:15.210553 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.210553 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:15.212308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.213129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:15.259477 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:15.259866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:15.260318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:15.260524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.261163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:15.261163 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.261163 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:15.261163 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.261163 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.261163 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:15.261163 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.261163 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:15.262573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:15.263438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:15.263438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.263438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:15.263438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.263438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.263438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:15.263438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.263438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:15.264512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.265349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.266224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:15.266224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.266224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:15.267134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:15.267134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:15.267796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:15.267796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.268740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:15.268740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.268740 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:15.268740 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.268740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.268740 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:15.268740 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.268740 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:15.269533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.270315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:15.270870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.271930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:15.272988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.272988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:15.272988 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:15.273169 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:15.273558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:15.273960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:15.274243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.275070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:15.275070 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.275070 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:15.275070 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.275070 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.275070 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:15.275070 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.275070 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.276293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:15.276867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:19.804756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:19.805719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:19.807032 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=434 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:31:19.838266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:19.838743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:19.839592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:19.839592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:19.839592 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:19.839592 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:19.839592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:19.839592 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:19.839592 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:19.839592 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:19.840484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:19.841370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:20.208221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:20.209353 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:20.209577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:20.209788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.210461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:20.210461 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.210461 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:20.210461 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.210461 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.210461 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:20.210461 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.210461 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:20.211705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.212487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:20.260039 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:20.260752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:20.261547 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:20.261915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.262946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:20.262946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.262946 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:20.262946 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.262946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.262946 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:20.262946 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.262946 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:20.264499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.265317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:20.266133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.266909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.267872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:20.267872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.267872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:20.267872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:20.267872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:20.267872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:20.268147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.268877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:20.268877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.268877 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:20.268877 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.268877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.268877 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:20.268877 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.268877 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:20.270056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.270539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:20.271690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.272158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:20.272639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.272639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:20.272639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:20.272971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:20.273396 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:20.273803 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:20.274039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.274715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:20.274715 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.274715 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:20.274715 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.274715 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.274715 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:20.274715 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.274715 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.275913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:20.276383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:24.805416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:24.807240 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:24.847637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:24.847825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:24.848290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:24.848290 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:24.848290 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:24.848290 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:24.848290 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:24.848290 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:24.848290 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:24.848290 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:24.849162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:24.850119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:25.208841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:25.209834 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:25.210098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:25.210269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.211008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:25.211008 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.211008 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:25.211008 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.211008 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.211008 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:25.211008 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.211008 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:25.212202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.213024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:25.260670 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:25.261296 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:25.261997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:25.262321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.263226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:25.263226 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.263226 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:25.263226 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.263226 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.263226 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:25.263226 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.263226 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:25.264678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.265216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:25.266457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.267003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.267509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:25.267509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.267509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:25.267509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:25.267657 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:25.268056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:25.268393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.269202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:25.269202 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.269202 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:25.269202 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.269202 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.269202 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:25.269202 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.269202 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:25.270391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.270894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:25.272143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.273407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:25.274107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.274107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:25.274107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:25.274107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:25.274107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:25.274107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:25.274399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.274680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:25.274680 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.274680 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:25.274680 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.274680 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.274680 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:25.274680 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.274680 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.275680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:25.276346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:29.806135 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:29.807750 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:29.848198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:29.848577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:29.849523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:29.849523 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:29.849523 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:29.849523 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:29.849523 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:29.849523 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:29.849523 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:29.849523 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:29.851043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:29.852254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:30.209388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:30.211163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:30.211531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:30.211848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.212868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:30.212868 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.212868 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:30.212868 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.212868 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.212868 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:30.212868 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.212868 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:30.214737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.215691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:30.261391 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:30.262136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:30.262827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:30.263176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.265045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.266179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:30.266921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.267661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.268472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:30.268472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.268472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:30.268472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:30.268472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:30.268472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:30.268832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.269486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:30.269486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.269486 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:30.269486 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.269486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.269486 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:30.269486 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.269486 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:30.270703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.271124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:30.272357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.272888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:30.273520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.273520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:30.273520 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:30.273809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:30.274101 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:30.274322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:30.274469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.274990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:30.274990 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.274990 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:30.274990 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.274990 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.274990 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:30.274990 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.274990 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.275980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:30.276453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:34.806904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:34.808530 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:34.847201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:34.847784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:34.848886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:34.848886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:34.848886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:34.848886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:34.848886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:34.848886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:34.848886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:34.848886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:34.850017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:34.851025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:35.210006 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:35.211428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:35.211809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:35.212082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.213132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:35.213132 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.213132 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:35.213132 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.213132 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.213132 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:35.213132 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.213132 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:35.214458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.215188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:35.262172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:35.262823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:35.263648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:35.263995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.265186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:35.265186 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.265186 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:35.265186 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.265186 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.265186 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:35.265186 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.265186 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:35.266582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.267343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:35.268328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.269149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.269979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:35.269979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.269979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:35.269979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:35.269979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:35.269979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:35.269979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.270599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:35.270599 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.270599 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:35.270599 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.270599 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.270599 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:35.270599 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.270599 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:35.271766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.272395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:35.273346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.273881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:35.274406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.274406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:35.274406 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:35.274406 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:35.274547 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:35.274752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:35.274891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.275438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:35.275438 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.275438 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:35.275438 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.275438 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.275438 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:35.275438 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.275438 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.277091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:35.277599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:39.807540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:39.809440 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:39.868056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:39.868285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:39.868894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:39.868894 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:39.868894 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:39.868894 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:39.868894 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:39.868894 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:39.868894 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:39.868894 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:39.869924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:39.870728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:40.210565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:40.212028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:40.212364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:40.212627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.213730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:40.213730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.213730 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:40.213730 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.213730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.213730 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:40.213730 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.213730 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:40.215732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.216351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:40.262891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:40.263507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:40.264098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:40.264323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.265079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:40.265079 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.265079 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:40.265079 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.265079 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.265079 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:40.265079 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.265079 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:40.266022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.266523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:40.267022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.267511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.268064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:40.268064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.268064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:40.269215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:40.269927 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:40.270448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:40.270958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.271864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:40.271864 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.271864 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:40.271864 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.271864 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.271864 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:40.271864 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.271864 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:40.273300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.273735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:40.275230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.275780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:40.276272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.276272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:40.276272 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:40.276272 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:40.276544 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:40.277337 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:40.277337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.277640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:40.277640 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.277640 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:40.277640 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.277640 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.277640 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:40.277640 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.277640 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.279407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:40.280335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:44.808161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:44.809117 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:44.838421 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:44.838716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:44.839422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:44.839422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:44.839422 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:44.839422 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:44.839422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:44.839422 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:44.839422 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:44.839422 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:44.840340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:44.840860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:45.211131 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:45.212333 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:45.212555 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:45.212750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.213197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:45.213197 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.213197 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:45.213197 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.213197 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.213197 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:45.213197 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.213197 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:45.214165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.214673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:45.263407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:45.263846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:45.264480 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:45.264771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.265400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:45.265400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.265400 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:45.265400 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.265400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.265400 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:45.265400 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.265400 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:45.266281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.266852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:45.267347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.268044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.268600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:45.268600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.268600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:45.269568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:45.269779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:45.270175 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:45.270465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.271129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:45.271129 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.271129 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:45.271129 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.271129 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.271129 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:45.271129 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.271129 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:45.271569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:45.272168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:45.272168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.272168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:45.272168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.272168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.272168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:45.272168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.272168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:45.272409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.273004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:45.273525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.273525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:45.276026 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:45.276662 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:45.277179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:45.277371 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:45.277502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.278297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:45.278297 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.278297 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:45.278297 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.278297 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.278297 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:45.278297 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.278297 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:45.281893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:49.808938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:49.810815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:49.848795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:49.849175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:49.850247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:49.850247 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:49.850247 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:49.850247 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:49.850247 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:49.850247 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:49.850247 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:49.850247 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:49.851306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:49.851710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:50.211825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:50.213066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:50.213278 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:50.213455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.214116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:50.214116 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.214116 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:50.214116 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.214116 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.214116 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:50.214116 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.214116 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:50.215398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.216136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:50.263970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:50.265084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:50.265084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:50.265253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.267651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.268585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:50.269030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.269583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.270178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:50.270178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.270178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:50.270178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:50.270178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:50.270608 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:50.270871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.271829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:50.271829 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.271829 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:50.271829 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.271829 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.271829 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:50.271829 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.271829 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:50.272599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:50.272987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:50.272987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.272987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:50.272987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.272987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.272987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:50.272987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.272987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:50.273753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.274181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:50.274652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.274652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:50.276488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:50.276991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:50.277515 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:50.277794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:50.277963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.278560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:50.278560 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.278560 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:50.278560 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.278560 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.278560 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:50.278560 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.278560 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.279771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:50.280273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:54.810737 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:54.812130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:54.851678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:54.852548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:54.853370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:55.212732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:55.213835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:55.214161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:55.214382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.215117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:31:55.215117 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.215117 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:55.215117 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.215117 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.215117 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:55.215117 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.215117 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:55.216010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.216374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:55.264726 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:55.265111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:31:55.265785 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:55.266037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.266910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:31:55.266910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.266910 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:55.266910 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.266910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.266910 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:55.266910 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.266910 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:55.268216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.268525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:31:55.270090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.270439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.270864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:55.270864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.270864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:55.270864 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:55.271155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:55.271981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:55.272422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.273039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:31:55.273039 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.273039 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:55.273039 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.273039 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.273039 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:55.273039 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.273039 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:31:55.274415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:55.274769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:31:55.274769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.274769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:31:55.274769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.274769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.274769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:31:55.274769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.274769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:31:55.276194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.276508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:55.276898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.276898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:55.277653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:55.277702 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:55.278199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:55.278449 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:55.278595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.279178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:31:55.279178 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.279178 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:55.279178 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.279178 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.279178 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:55.279178 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.279178 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.280027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:55.280366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:31:59.810684 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:31:59.812264 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:31:59.847517 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:31:59.847933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:59.848877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:31:59.848877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:59.848877 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:31:59.848877 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:31:59.848877 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:59.848877 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:31:59.848877 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:59.848877 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:59.850088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:31:59.851095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:00.213370 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:00.214664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:00.215076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:00.215360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.216383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:00.216383 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.216383 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:00.216383 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.216383 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.216383 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:00.216383 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.216383 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:00.217715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.218205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:00.265226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:00.265931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:00.266773 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:00.267211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.268212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:00.268212 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.268212 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:00.268212 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.268212 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.268212 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:00.268212 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.268212 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:00.270005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.271271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:00.272106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.272804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.273465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:00.273465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.273465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:00.273465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:00.273465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:00.273465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:00.273756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.274473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:00.274473 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.274473 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:00.274473 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.274473 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.274473 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:00.274473 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.274473 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:00.275408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.276038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:00.276783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.277296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:00.277795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.277795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:00.277795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:00.278206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:00.278746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:00.279121 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:00.279372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.280082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:00.280082 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.280082 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:00.280082 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.280082 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.280082 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:00.280082 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.280082 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.281173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:00.281686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:04.811291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:04.813066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:04.851060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:04.851483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:04.852386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:04.852386 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:04.852386 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:04.852386 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:04.852386 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:04.852386 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:04.852386 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:04.852386 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:04.853557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:04.854037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:05.214145 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:05.215549 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:05.216098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:05.216197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.217608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:05.217608 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.217608 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:05.217608 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.217608 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.217608 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:05.217608 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.217608 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:05.219919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.221203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:05.265855 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:05.266192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:05.266790 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:05.267098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:05.267986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.267986 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:05.267986 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.267986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.267986 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:05.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.267986 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:05.269367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.269847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:05.270965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.271467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.272009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:05.272009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.272009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:05.272789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:05.273030 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:05.273504 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:05.273931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.274596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:05.274596 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.274596 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:05.274596 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.274596 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.274596 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:05.274596 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.274596 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:05.275601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:05.276101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:05.276101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.276101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:05.276101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.276101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.276101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:05.276101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.276101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:05.276751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.277221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:05.277777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.277777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:05.277991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:05.278263 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:05.278687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:05.279026 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:05.279280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.280000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:05.280000 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.280000 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:05.280000 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.280000 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.280000 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:05.280000 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.280000 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.281000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:05.281494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:09.812044 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:09.813861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:09.849567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:09.849961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:09.850899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:09.850899 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:09.850899 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:09.850899 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:09.850899 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:09.850899 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:09.850899 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:09.850899 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:09.851976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:09.852949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:10.214940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:10.216169 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:10.216448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:10.216828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.217906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:10.217906 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.217906 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:10.217906 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.217906 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.217906 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:10.217906 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.217906 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:10.220582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.221358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:10.266335 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:10.266977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:10.267599 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:10.268011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.269011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:10.269011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.269011 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:10.269011 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.269011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.269011 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:10.269011 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.269011 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:10.270547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.271320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:10.272314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.273023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.273848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:10.273848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.273848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:10.273848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:10.273848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:10.274143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:10.274509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.275014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:10.275014 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.275014 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:10.275014 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.275014 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.275014 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:10.275014 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.275014 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:10.275737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:10.276218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:10.276218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.276218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:10.276218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.276218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.276218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:10.276218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.276218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:10.276759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.277282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:10.277840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.277840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:10.278235 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:10.279038 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:10.279376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:10.279593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:10.279761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.280222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:10.280222 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.280222 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:10.280222 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.280222 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.280222 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:10.280222 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.280222 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.281246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:10.281776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:14.812820 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:14.814423 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:14.856179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:14.856583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:14.857541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:14.857541 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:14.857541 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:14.857541 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:14.857541 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:14.857541 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:14.857541 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:14.857541 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:14.858499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:14.859350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:15.215664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:15.217046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:15.217368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:15.217657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.218824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:15.218824 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.218824 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:15.218824 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.218824 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.218824 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:15.218824 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.218824 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:15.220900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.221583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:15.266923 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:15.267576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:15.268184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:15.268496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.269385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:15.269385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.269385 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:15.269385 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.269385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.269385 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:15.269385 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.269385 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:15.270896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.271527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:15.273366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.274303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.275112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:15.275112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.275112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:15.275112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:15.275112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:15.275112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:15.275112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.275644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:15.275644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.275644 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:15.275644 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.275644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.275644 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:15.275644 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.275644 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:15.276384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:15.277450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.278191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:15.279039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.279039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:15.279039 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:15.279202 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:15.279558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:15.279909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:15.280119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.280775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:15.280775 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.280775 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:15.280775 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.280775 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.280775 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:15.280775 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.280775 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.282301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:15.282853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:19.813510 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:19.815164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:19.816988 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:32:19.851006 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:19.851300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:19.852190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:19.852190 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:19.852190 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:19.852190 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:19.852190 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:19.852190 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:19.852190 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:19.852190 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:19.853055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:19.854023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:20.216358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:20.217894 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:20.218242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:20.218493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.219777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:20.219777 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.219777 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:20.219777 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.219777 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.219777 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:20.219777 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.219777 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:20.221677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.222320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:20.267883 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:20.268506 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:20.269246 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:20.269562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.270406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:20.270406 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.270406 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:20.270406 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.270406 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.270406 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:20.270406 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.270406 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:20.271916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.272728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:20.273734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.274277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.274846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:20.274846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.274846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:20.274846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:20.274846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:20.275019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:20.275346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.276107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:20.276107 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.276107 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:20.276107 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.276107 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.276107 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:20.276107 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.276107 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:20.276886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.277437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:20.277955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.278491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:20.279225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.279225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:20.279225 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:20.279600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:20.280153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:20.280505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:20.280797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.281539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:20.281539 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.281539 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:20.281539 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.281539 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.281539 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:20.281539 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.281539 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.283229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:20.283767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:24.814305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:24.815419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:24.848042 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:24.848501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:24.849479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:24.849479 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:24.849479 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:24.849479 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:24.849479 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:24.849479 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:24.849479 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:24.849479 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:24.850773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:24.851874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:25.217080 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:25.218160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:25.218357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:25.218508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.219185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:25.219185 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.219185 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:25.219185 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.219185 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.219185 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:25.219185 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.219185 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:25.220237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.220898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:25.268462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:25.268925 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:25.269776 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:25.270208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.271303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:25.271303 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.271303 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:25.271303 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.271303 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.271303 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:25.271303 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.271303 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:25.272570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.273427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:25.274187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.274983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.275775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:25.275775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.275775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:25.275775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:25.275775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:25.275775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:25.276060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.277021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:25.277021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.277021 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:25.277021 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.277021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.277021 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:25.277021 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.277021 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:25.277854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.278275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:25.278981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.279432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:25.280014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.280014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:25.280014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:25.280014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:25.280338 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:25.280551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:25.280740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.281348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:25.281348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.281348 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:25.281348 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.281348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.281348 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:25.281348 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.281348 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.283669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:25.284571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:29.815071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:29.816583 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:29.852854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:29.853307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:29.854374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:29.854374 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:29.854374 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:29.854374 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:29.854374 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:29.854374 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:29.854374 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:29.854374 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:29.855265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:29.856205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:30.217786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:30.219074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:30.219494 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:30.219796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.220986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:30.220986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.220986 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:30.220986 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.220986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.220986 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:30.220986 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.220986 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:30.223010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.223785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:30.268966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:30.269364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:30.269942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:30.270246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.271035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:30.271035 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.271035 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:30.271035 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.271035 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.271035 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:30.271035 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.271035 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:30.272233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.273517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:30.274179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.275176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.276356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:30.276356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.276356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:30.276356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:30.276356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:30.276356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:30.276356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.276956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:30.276956 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.276956 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:30.276956 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.276956 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.276956 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:30.276956 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.276956 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:30.278124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.278838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:30.279900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.280456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:30.281143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.281143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:30.281143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:30.281143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:30.281664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:30.281982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:30.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.282578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:30.282578 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.282578 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:30.282578 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.282578 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.282578 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:30.282578 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.282578 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.283871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:30.284411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:34.815843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:34.816810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:34.855074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:34.855782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:34.856068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:34.856068 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:34.856068 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:34.856068 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:34.856068 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:34.856068 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:34.856068 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:34.856068 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:34.857105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:34.858094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:35.218526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:35.219942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:35.220606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:35.220606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.221300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:35.221300 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.221300 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:35.221300 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.221300 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.221300 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:35.221300 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.221300 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:35.223334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.224449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:35.269458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:35.270344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:35.270344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:35.270746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.271393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:35.271393 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.271393 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:35.271393 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.271393 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.271393 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:35.271393 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.271393 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:35.272306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.272880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:35.273336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.273824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.274372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:35.274372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.274372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:35.275197 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:35.275687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:35.276126 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:35.276513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.277448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:35.277448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.277448 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:35.277448 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.277448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.277448 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:35.277448 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.277448 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:35.278555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.279049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:35.279824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.280435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:35.281182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.281182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:35.281182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:35.281182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:35.281364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:35.281505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:35.281675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.282122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:35.282122 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.282122 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:35.282122 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.282122 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.282122 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:35.282122 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.282122 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.283151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:35.283656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:39.816446 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:39.817909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:39.849193 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:39.849459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:39.850164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:39.850164 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:39.850164 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:39.850164 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:39.850164 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:39.850164 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:39.850164 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:39.850164 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:39.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:39.853219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:40.219355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:40.220815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:40.221238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:40.221573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.222968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:40.222968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.222968 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:40.222968 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.222968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.222968 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:40.222968 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.222968 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:40.224793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.225368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:40.270112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:40.270727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:40.271257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:40.271536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.272419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:40.272419 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.272419 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:40.272419 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.272419 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.272419 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:40.272419 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.272419 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:40.274082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.275380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:40.276583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.278236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.279496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:40.279496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.279496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:40.279496 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:40.279496 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:40.279496 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:40.279496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.279920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:40.279920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.279920 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:40.279920 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.279920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.279920 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:40.279920 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.279920 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:40.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.281867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:40.283722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.284225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:40.285256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.285256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:40.285256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:40.285256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:40.285256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:40.285256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:40.285488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.285809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:40.285809 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.285809 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:40.285809 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.285809 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.285809 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:40.285809 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.285809 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:40.287504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:44.817221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:44.818865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:44.861364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:44.861873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:44.862717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:44.862717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:44.862717 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:44.862717 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:44.862717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:44.862717 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:44.862717 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:44.862717 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:44.863558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:44.864134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:45.220055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:45.221446 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:45.221920 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:45.222450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.223564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:45.223564 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.223564 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:45.223564 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.223564 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.223564 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:45.223564 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.223564 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:45.225646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.226250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:45.270842 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:45.271606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:45.272487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:45.272741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.273743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:45.273743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.273743 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:45.273743 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.273743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.273743 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:45.273743 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.273743 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:45.275427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.276660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:45.277769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.279252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:45.280206 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.281938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:45.282420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.283120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:45.284359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:45.284945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:45.285301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:45.285516 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:45.285690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.286237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:45.286237 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.286237 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:45.286237 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.286237 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.286237 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:45.286237 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.286237 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.287865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:45.288570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:49.817866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:49.819471 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:49.855441 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:49.855682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:49.856292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:49.856292 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:49.856292 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:49.856292 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:49.856292 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:49.856292 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:49.856292 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:49.856292 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:49.857193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:49.858295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:50.221110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:50.222311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:50.222600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:50.222849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.223917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:50.223917 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.223917 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:50.223917 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.223917 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.223917 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:50.223917 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.223917 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:50.226305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.227300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:50.271678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:50.272140 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:50.272809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:50.273137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.274048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:50.274048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.274048 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:50.274048 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.274048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.274048 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:50.274048 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.274048 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:50.275421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.276343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:50.277168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.277905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.278801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:50.278801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.278801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:50.278801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:50.279281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:50.280264 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:50.280264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.280998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:50.280998 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.280998 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:50.280998 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.280998 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.280998 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:50.280998 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.280998 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:50.282302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.283106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:50.284030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.284541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:50.285065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.285065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:50.285065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:50.285420 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:50.285798 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:50.286013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:50.286157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.286668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:50.286668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.286668 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:50.286668 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.286668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.286668 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:50.286668 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.286668 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.288478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:50.288947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:54.818484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:54.820134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:54.856891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:54.857185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:54.858480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:54.858480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:54.858480 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:54.858480 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:54.858480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:54.858480 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:54.858480 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:54.858480 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:54.859349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:54.859853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:55.221724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:55.223003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:55.223251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:55.223456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.224175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:32:55.224175 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.224175 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:55.224175 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.224175 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.224175 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:55.224175 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.224175 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:55.225983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.226852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:55.272141 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:55.273084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:32:55.273836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:55.274289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.275161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:32:55.275161 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.275161 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:55.275161 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.275161 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.275161 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:55.275161 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.275161 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:55.276491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.276955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:32:55.277953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.278451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.279065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:55.279065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.279065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:55.279065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:55.279640 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:55.280309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:55.280786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.281567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:32:55.281567 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.281567 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:55.281567 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.281567 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.281567 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:55.281567 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.281567 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:32:55.282961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.283504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:32:55.284599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.285170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:55.285651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.285651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:55.285651 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:55.286165 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:55.286719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:55.287168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.288672 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.289846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:55.290283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:32:59.819117 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:32:59.820604 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:32:59.854866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:32:59.855215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:59.856075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:32:59.856075 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:59.856075 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:32:59.856075 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:32:59.856075 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:59.856075 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:32:59.856075 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:59.856075 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:59.856948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:32:59.857480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:00.222404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:00.223937 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:00.224473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:00.224792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.225986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:00.225986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.225986 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:00.225986 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.225986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.225986 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:00.225986 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.225986 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:00.227688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.228445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:00.272779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:00.273547 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:00.274416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:00.274947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.276171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:00.276171 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.276171 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:00.276171 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.276171 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.276171 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:00.276171 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.276171 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:00.277552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.278284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:00.278694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.279383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.280473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:00.280473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.280473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:00.280473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:00.280473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:00.280473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:00.280826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.281652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:00.281652 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.281652 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:00.281652 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.281652 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.281652 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:00.281652 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.281652 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:00.282939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.283318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:00.284713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.285148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:00.285707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.285707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:00.285788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:00.286331 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:00.286778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:00.287143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:00.287391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.288357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:00.288357 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.288357 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:00.288357 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.288357 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.288357 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:00.288357 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.288357 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.289258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:00.290059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:04.819794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:04.821821 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:04.860501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:04.860816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:04.861747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:04.861747 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:04.861747 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:04.861747 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:04.861747 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:04.861747 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:04.861747 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:04.861747 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:04.862628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:04.863164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:05.223220 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:05.224713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:05.225110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:05.225402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.226504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:05.226504 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.226504 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:05.226504 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.226504 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.226504 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:05.226504 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.226504 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:05.228501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.229420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:05.273293 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:05.273764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:05.274519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:05.274915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.275769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:05.275769 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.275769 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:05.275769 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.275769 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.275769 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:05.275769 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.275769 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:05.276538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.277307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:05.277763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.279269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:05.279269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.279269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:05.279839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:05.280091 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:05.280528 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:05.280944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.281716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:05.281716 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.281716 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:05.281716 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.281716 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.281716 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:05.281716 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.281716 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:05.282592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.283146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:05.283750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.284300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:05.284853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.284853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:05.286125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:05.286369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:05.286815 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:05.287149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:05.287373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.288236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:05.288236 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.288236 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:05.288236 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.288236 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.288236 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:05.288236 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.288236 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.289703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:05.290194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:09.820403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:09.822030 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:09.856256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:09.856815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:09.857751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:09.857751 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:09.857751 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:09.857751 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:09.857751 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:09.857751 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:09.857751 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:09.857751 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:09.858907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:09.860046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:10.224495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:10.225149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:10.225488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:10.225771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.226642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:10.226642 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.226642 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:10.226642 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.226642 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.226642 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:10.226642 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.226642 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:10.227928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.228917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:10.273752 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:10.274102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:10.274861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:10.275219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.275987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:10.275987 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.275987 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:10.275987 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.275987 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.275987 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:10.275987 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.275987 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:10.277519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.278360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:10.279628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.280455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.281456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:10.281456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.281456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:10.281456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:10.281456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:10.281769 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:10.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.282822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:10.282822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.282822 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:10.282822 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.282822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.282822 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:10.282822 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.282822 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:10.284422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:10.286320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.287299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:10.288239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.288239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:10.288239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:10.288239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:10.288239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:10.288239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:10.288239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.289127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:10.289127 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.289127 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:10.289127 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.289127 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.289127 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:10.289127 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.289127 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.290460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:10.290984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:14.820996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:14.822507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:14.863415 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:14.863793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:14.864447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:14.864447 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:14.864447 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:14.864447 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:14.864447 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:14.864447 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:14.864447 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:14.864447 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:14.865543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:14.866210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:15.224505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:15.225753 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:15.226020 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:15.226235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.227220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:15.227220 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.227220 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:15.227220 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.227220 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.227220 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:15.227220 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.227220 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:15.228929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.229691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:15.274367 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:15.275055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:15.275698 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:15.276156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.277160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:15.277160 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.277160 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:15.277160 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.277160 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.277160 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:15.277160 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.277160 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:15.278012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.278535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:15.279315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.279793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.280375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:15.280375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.280375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:15.280724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:15.281017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:15.281308 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:15.281551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.282115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:15.282115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.282115 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:15.282115 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.282115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.282115 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:15.282115 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.282115 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:15.283387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:15.283874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:15.283874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.283874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:15.283874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.283874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.283874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:15.283874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.283874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:15.285081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.285551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:15.286052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.286052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:15.287049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:15.287484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:15.287917 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:15.288273 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:15.288505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.289256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:15.289256 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.289256 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:15.289256 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.289256 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.289256 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:15.289256 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.289256 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.290979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:15.291461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:19.821725 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:19.823354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:19.825196 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:33:19.856934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:19.857743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:19.857992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:19.857992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:19.857992 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:19.857992 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:19.857992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:19.857992 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:19.857992 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:19.857992 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:19.859344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:19.859963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:20.225109 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:20.227598 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:20.227598 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:20.227598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.228498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:20.228498 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.228498 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:20.228498 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.228498 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.228498 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:20.228498 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.228498 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:20.230473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.231320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:20.274870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:20.275293 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:20.275934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:20.276787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.277192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:20.277192 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.277192 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:20.277192 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.277192 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.277192 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:20.277192 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.277192 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:20.278517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.279356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:20.280204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.281154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.282019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:20.282019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.282019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:20.282019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:20.282019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:20.282019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:20.282398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.283125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:20.283125 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.283125 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:20.283125 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.283125 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.283125 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:20.283125 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.283125 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:20.284287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:20.284741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:20.284741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.284741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:20.284741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.284741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.284741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:20.284741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.284741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:20.286034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.286474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:20.287005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.287005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:20.287384 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:20.287891 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:20.288247 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:20.288526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:20.288694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.289173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:20.289173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.289173 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:20.289173 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.289173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.289173 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:20.289173 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.289173 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.290158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:20.290660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:24.822507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:24.824097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:24.860675 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:24.860959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:24.861700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:24.861700 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:24.861700 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:24.861700 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:24.861700 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:24.861700 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:24.861700 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:24.861700 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:24.862840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:24.863772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:25.226052 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:25.227497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:25.228000 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:25.228862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.229551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:25.229551 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.229551 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:25.229551 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.229551 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.229551 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:25.229551 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.229551 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:25.231813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.232307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:25.275538 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:25.276280 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:25.277003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:25.277241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.278028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:25.278028 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.278028 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:25.278028 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.278028 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.278028 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:25.278028 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.278028 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:25.279642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.280096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:25.281417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.281890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.282382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:25.282382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.282382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:25.282382 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:25.282382 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:25.282827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:25.283198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.284216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:25.284216 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.284216 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:25.284216 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.284216 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.284216 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:25.284216 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.284216 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:25.285571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.285992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:25.286624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.287078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:25.287570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.287570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:25.287848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:25.288402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:25.289191 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:25.289191 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:25.289531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.290049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:25.290049 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.290049 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:25.290049 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.290049 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.290049 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:25.290049 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.290049 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:25.294436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:29.823046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:29.824715 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:29.861535 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:29.861967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:29.862905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:29.862905 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:29.862905 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:29.862905 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:29.862905 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:29.862905 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:29.862905 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:29.862905 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:29.863847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:29.864820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:30.226777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:30.229984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:30.230214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:30.230374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.230992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:30.230992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.230992 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:30.230992 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.230992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.230992 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:30.230992 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.230992 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:30.232124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.232829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:30.276330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:30.276873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:30.277415 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:30.277755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.278513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:30.278513 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.278513 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:30.278513 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.278513 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.278513 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:30.278513 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.278513 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:30.279773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.280534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:30.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.281991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.282754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:30.282754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.282754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:30.282754 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:30.282754 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:30.282998 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:30.283376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.284057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:30.284057 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.284057 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:30.284057 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.284057 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.284057 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:30.284057 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.284057 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:30.285103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:30.285591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:30.285591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.285591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:30.285591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.285591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.285591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:30.285591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.285591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:30.286167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.286698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:30.287311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.287311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:30.288225 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:30.288764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:30.289138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:30.289401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:30.289581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.290164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:30.290164 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.290164 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:30.290164 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.290164 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.290164 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:30.290164 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.290164 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.291319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:30.291958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:34.823844 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:34.825682 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:34.860025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:34.860575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:34.861536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:34.861536 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:34.861536 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:34.861536 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:34.861536 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:34.861536 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:34.861536 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:34.861536 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:34.862524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:34.863103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:35.228121 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:35.229380 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:35.229680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:35.229902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.230789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:35.230789 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.230789 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:35.230789 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.230789 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.230789 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:35.230789 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.230789 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:35.232493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.233263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:35.277084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:35.277694 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:35.278442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:35.278783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.279650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:35.279650 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.279650 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:35.279650 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.279650 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.279650 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:35.279650 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.279650 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:35.281508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.282307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:35.283660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.284598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.285541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:35.285541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.285541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:35.285541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:35.285541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:35.285541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:35.285541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.286163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:35.286163 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.286163 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:35.286163 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.286163 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.286163 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:35.286163 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.286163 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:35.286864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.287334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:35.288048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.288512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:35.289056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.289056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:35.289056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:35.289161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:35.289528 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:35.289906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:35.290143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.290845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:35.290845 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.290845 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:35.290845 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.290845 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.290845 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:35.290845 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.290845 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.292339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:35.292867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:39.825051 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:39.826642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:39.860507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:39.861102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:39.861810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:39.861810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:39.861810 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:39.861810 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:39.861810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:39.861810 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:39.861810 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:39.861810 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:39.862720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:39.863323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:40.228659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:40.229549 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:40.229813 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:40.229953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.230481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:40.230481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.230481 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:40.230481 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.230481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.230481 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:40.230481 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.230481 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:40.231546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.232467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:40.277811 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:40.278428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:40.279118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:40.279379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.280048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:40.280048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.280048 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:40.280048 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.280048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.280048 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:40.280048 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.280048 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:40.281557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:40.282141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:40.282141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.282141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:40.282141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.282141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.282141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:40.282141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.282141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:40.283543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.284864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:40.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:40.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:40.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:40.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:40.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.286317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:40.286317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.286317 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:40.286317 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.286317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.286317 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:40.286317 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.286317 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:40.287714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.288601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:40.289483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.290327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:40.291249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.291249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:40.291249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:40.291249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:40.291249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:40.291249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:40.291249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.291676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:40.291676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.291676 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:40.291676 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.291676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.291676 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:40.291676 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.291676 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.292512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:40.293301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:44.826098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:44.828229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:44.864996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:44.865431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:44.866305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:44.866305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:44.866305 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:44.866305 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:44.866305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:44.866305 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:44.866305 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:44.866305 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:44.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:44.869119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:45.229242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:45.230392 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:45.230835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:45.231107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.232068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:45.232068 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.232068 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:45.232068 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.232068 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.232068 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:45.232068 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.232068 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:45.233002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.234041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:45.278538 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:45.279186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:45.279762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:45.279982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.280590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:45.280590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.280590 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:45.280590 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.280590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.280590 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:45.280590 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.280590 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:45.282118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:45.283131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:45.283131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.283131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:45.283131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.283131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.283131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:45.283131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.283131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:45.283771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.284579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.285493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:45.285493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.285493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:45.285493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:45.285748 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:45.286179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:45.286469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.287217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:45.287217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.287217 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:45.287217 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.287217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.287217 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:45.287217 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.287217 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:45.288562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.289199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:45.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.290977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:45.291468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.291468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:45.291468 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:45.291468 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:45.291696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:45.291918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:45.292071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.292682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:45.292682 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.292682 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:45.292682 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.292682 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.292682 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:45.292682 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.292682 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.294513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:45.295076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:49.826863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:49.828566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:49.865231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:49.865675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:49.866544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:49.866544 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:49.866544 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:49.866544 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:49.866544 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:49.866544 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:49.866544 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:49.866544 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:49.867463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:49.868437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:50.229984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:50.231480 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:50.231827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:50.233156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.233638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:50.233638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.233638 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:50.233638 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.233638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.233638 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:50.233638 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.233638 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:50.235587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.236569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:50.279189 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:50.279583 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:50.280163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:50.280476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.281244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:50.281244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.281244 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:50.281244 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.281244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.281244 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:50.281244 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.281244 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:50.282373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:50.283284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:50.283284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.283284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:50.283284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.283284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.283284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:50.283284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.283284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:50.283870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.284528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.285381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:50.285381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.285381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:50.285381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:50.285939 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:50.286308 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:50.286513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.287177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:50.287177 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.287177 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:50.287177 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.287177 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.287177 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:50.287177 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.287177 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:50.288506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.289216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:50.290219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.290834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:50.291307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.291307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:50.291307 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:50.292003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:50.292316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:50.292523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:50.292691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.293238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:50.293238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.293238 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:50.293238 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.293238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.293238 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:50.293238 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.293238 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.295056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:50.295585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:54.827690 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:54.829308 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:54.862255 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:54.862551 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:54.863330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:54.863330 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:54.863330 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:54.863330 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:54.863330 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:54.863330 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:54.863330 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:54.863330 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:54.864465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:54.865395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:55.230830 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:55.232097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:55.232466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:55.232813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.233985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:33:55.233985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.233985 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:55.233985 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.233985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.233985 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:55.233985 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.233985 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:55.236100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.236918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:55.280219 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:55.280926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:33:55.281488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:55.281851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.282730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:33:55.282730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.282730 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:55.282730 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.282730 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.282730 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:55.282730 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.282730 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:55.283502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:55.284266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:55.284266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.284266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:55.284266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.284266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.284266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:55.284266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.284266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:33:55.284689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.285416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.286311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:55.286311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.286311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:55.286311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:55.286567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:55.287007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:55.287275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.287845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:33:55.287845 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.287845 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:55.287845 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.287845 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.287845 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:55.287845 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.287845 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:33:55.289249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.289680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:33:55.291150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.291584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:55.292123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.292123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:55.292123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:55.292123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:55.292458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:55.292746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:55.292912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.293560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:33:55.293560 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.293560 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:55.293560 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.293560 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.293560 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:55.293560 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.293560 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.295547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:55.296035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:33:59.828360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:33:59.830167 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:33:59.862256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:33:59.862763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:59.863872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:33:59.863872 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:59.863872 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:33:59.863872 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:33:59.863872 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:59.863872 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:33:59.863872 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:59.863872 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:59.865025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:33:59.865604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:00.231377 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:00.233230 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:00.233467 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:00.233682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.234497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:00.234497 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.234497 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:00.234497 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.234497 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.234497 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:00.234497 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.234497 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:00.236215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.237552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:00.280867 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:00.281331 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:00.282004 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:00.282410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.283379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:00.283379 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.283379 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:00.283379 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.283379 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.283379 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:00.283379 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.283379 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:00.284553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:00.285383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:00.285383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.285383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:00.285383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.285383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.285383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:00.285383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.285383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:00.286209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.287279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.288361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:00.288361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.288361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:00.288361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:00.288361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:00.288361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:00.288361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.289015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:00.289015 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.289015 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:00.289015 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.289015 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.289015 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:00.289015 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.289015 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:00.290132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:00.290812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:00.290812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.290812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:00.290812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.290812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.290812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:00.290812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.290812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:00.291499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.291984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:00.292469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.292469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:00.292469 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:00.292581 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:00.293044 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:00.293256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:00.293394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.293960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:00.293960 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.293960 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:00.293960 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.293960 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.293960 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:00.293960 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.293960 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.295818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:00.296288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:04.829068 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:04.830458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:04.852775 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:04.853119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:04.853944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:04.853944 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:04.853944 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:04.853944 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:04.853944 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:04.853944 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:04.853944 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:04.853944 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:04.854797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:04.855763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:05.232352 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:05.233885 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:05.234240 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:05.234607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.235781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:05.235781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.235781 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:05.235781 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.235781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.235781 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:05.235781 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.235781 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:05.237725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.238236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:05.281457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:05.281789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:05.282503 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:05.282867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.283838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:05.283838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.283838 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:05.283838 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.283838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.283838 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:05.283838 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.283838 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:05.285495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:05.286067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:05.286067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.286067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:05.286067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.286067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.286067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:05.286067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.286067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:05.287441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.287924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.288403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:05.288403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.288403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:05.288403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:05.288403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:05.288953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:05.289316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.290218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:05.290218 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.290218 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:05.290218 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.290218 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.290218 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:05.290218 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.290218 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:05.291054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.291907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:05.292291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:05.294017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.294017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:05.294017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:05.294017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:05.294017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:05.294017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:05.294445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.295099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:05.295099 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.295099 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:05.295099 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.295099 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.295099 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:05.295099 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.295099 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:05.297066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:09.829745 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:09.831459 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:09.864519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:09.864936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:09.865852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:09.865852 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:09.865852 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:09.865852 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:09.865852 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:09.865852 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:09.865852 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:09.865852 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:09.866860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:09.867808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:10.233012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:10.234319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:10.234590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:10.234973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.236189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:10.236189 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.236189 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:10.236189 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.236189 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.236189 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:10.236189 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.236189 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:10.238043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.238717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:10.281915 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:10.282266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:10.283022 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:10.283342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.284190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:10.284190 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.284190 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:10.284190 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.284190 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.284190 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:10.284190 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.284190 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:10.285289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:10.286318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:10.286318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.286318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:10.286318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.286318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.286318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:10.286318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.286318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:10.286808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.287726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.288836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:10.288836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.288836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:10.288836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:10.288836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:10.289229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:10.289351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.290121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:10.290121 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.290121 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:10.290121 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.290121 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.290121 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:10.290121 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.290121 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:10.290917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.291346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:10.292079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.292585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:10.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:10.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:10.293150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:10.293395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:10.293631 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:10.293773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.294268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:34:10.294268 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.294268 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:10.294268 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.294268 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.294268 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:10.294268 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.294268 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.295443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:10.296032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:14.830458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:14.832028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:14.865577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:14.865884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:14.866729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:14.866729 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:14.866729 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:14.866729 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:14.866729 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:14.866729 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:14.866729 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:14.866729 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:14.867925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:14.868859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:15.233786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:15.234840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:15.235228 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:15.235469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.236480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:15.236480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.236480 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:15.236480 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.236480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.236480 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:15.236480 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.236480 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:15.237723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.238546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:15.282465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:15.283172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:15.284280 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:15.284426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:15.285189 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.285189 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:15.285189 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.285189 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.285189 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:15.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.285189 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:15.286490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:15.287200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:15.287200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.287200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:15.287200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.287200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.287200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:15.287200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.287200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:15.288072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.288674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.289363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:15.289363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.289363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:15.289363 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:15.289363 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:15.289652 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:15.289844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.290503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:15.290503 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.290503 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:15.290503 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.290503 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.290503 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:15.290503 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.290503 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:15.291845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.292271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:15.293444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.293954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:15.294674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.294674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:15.294674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:15.294674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:15.294674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:15.295075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:15.295264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.295899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:34:15.295899 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.295899 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:15.295899 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.295899 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.295899 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:15.295899 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.295899 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.297094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:15.297592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:19.831118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:19.832763 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:19.834461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:34:19.864645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:19.865235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:19.866312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:19.866312 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:19.866312 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:19.866312 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:19.866312 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:19.866312 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:19.866312 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:19.866312 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:19.867213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:19.868180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:20.234522 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:20.235754 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:20.235947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:20.236116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.236807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:20.236807 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.236807 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:20.236807 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.236807 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.236807 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:20.236807 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.236807 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:20.238710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.239645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:20.283114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:20.283746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:20.284495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:20.284875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.285724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:20.285724 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.285724 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:20.285724 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.285724 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.285724 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:20.285724 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.285724 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:20.287067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:20.287902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:20.287902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.287902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:20.287902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.287902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.287902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:20.287902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.287902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:20.288656 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.289541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:20.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:20.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:20.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:20.290501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:20.290930 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.291528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:20.291528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.291528 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:20.291528 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.291528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.291528 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:20.291528 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.291528 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:20.293216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.293867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:20.295278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.295897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:20.296457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.296457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:20.296457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:20.296457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:20.296457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:20.296817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:20.297093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.297854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:20.297854 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.297854 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:20.297854 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.297854 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.297854 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:20.297854 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.297854 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.298998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:20.299561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:24.831871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:24.833251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:24.864188 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:24.864877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:24.865464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:24.865464 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:24.865464 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:24.865464 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:24.865464 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:24.865464 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:24.865464 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:24.865464 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:24.866437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:24.867394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:25.235329 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:25.236743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:25.237097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:25.237344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.238414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:25.238414 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.238414 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:25.238414 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.238414 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.238414 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:25.238414 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.238414 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:25.240293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.241155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:25.283851 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:25.284582 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:25.285224 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:25.285584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.286358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:25.286358 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.286358 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:25.286358 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.286358 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.286358 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:25.286358 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.286358 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:25.287572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:25.288412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:25.288412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.288412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:25.288412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.288412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.288412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:25.288412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.288412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:25.289079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.289905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.290905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:25.290905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.290905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:25.290905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:25.290905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:25.290905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:25.290905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.291525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:34:25.291525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.291525 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:25.291525 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.291525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.291525 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:25.291525 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.291525 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:25.292819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.293347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:25.294576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.295071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:25.295610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.295610 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:25.295899 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:25.296476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:25.296840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:25.297048 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:25.297183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.297797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:25.297797 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.297797 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:25.297797 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.297797 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.297797 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:25.297797 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.297797 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.299832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:25.300344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:29.832474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:29.833874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:29.870088 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:29.870571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:29.870749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:29.870749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:29.870749 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:29.870749 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:29.870749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:29.870749 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:29.870749 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:29.870749 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:29.871530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:29.872096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:30.236076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:30.237300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:30.237475 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:30.237710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.238518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:30.238518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.238518 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:30.238518 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.238518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.238518 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:30.238518 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.238518 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:30.240670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.241049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:30.284580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:30.285239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:30.285903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:30.286210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.287102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:30.287102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.287102 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:30.287102 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.287102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.287102 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:30.287102 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.287102 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:30.288424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:30.289957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:30.289957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.289957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:30.289957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.289957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.289957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:30.289957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.289957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:30.290575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.291692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:30.292938 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.293837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.293837 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:30.293837 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.293837 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:30.294295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.295270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:30.296608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.297282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:30.298018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.298018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:30.298018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:30.298018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:30.298018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:30.298324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:30.298557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.299316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:30.299316 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.299316 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:30.299316 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.299316 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.299316 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:30.299316 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.299316 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.300645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:30.301401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:34.833154 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:34.834911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:34.872883 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:34.873315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:34.874401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:34.874401 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:34.874401 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:34.874401 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:34.874401 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:34.874401 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:34.874401 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:34.874401 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:34.875654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:34.876541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:35.236809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:35.238265 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:35.238544 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:35.238782 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.239716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:35.239716 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.239716 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:35.239716 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.239716 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.239716 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:35.239716 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.239716 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:35.241659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.242152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:35.285275 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:35.285783 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:35.286356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:35.286784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.287580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:35.287580 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.287580 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:35.287580 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.287580 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.287580 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:35.287580 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.287580 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:35.288338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:35.289202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:35.289202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.289202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:35.289202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.289202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.289202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:35.289202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.289202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:35.289565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.290311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.291151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:35.291151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.291151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:35.291151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:35.291348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:35.291841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:35.292245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.292979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:34:35.292979 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.292979 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:35.292979 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.292979 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.292979 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:35.292979 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.292979 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:35.294185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.294954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:35.295932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.296580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:35.297178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.297178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:35.297465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:35.298033 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:35.298504 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:35.298964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:35.299203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.299819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:35.299819 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.299819 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:35.299819 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.299819 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.299819 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:35.299819 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.299819 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.301058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:35.301586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:39.833842 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:39.870076 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:39.870529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:39.871130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:40.237561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:40.239379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:40.239379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:40.239379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.240648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:40.240648 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.240648 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:40.240648 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.240648 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.240648 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:40.240648 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.240648 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:40.242413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.243335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:40.286550 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.289819 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:40.290222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:40.290724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:40.290724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.290724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:40.290724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.290724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.290724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:40.290724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.290724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:40.291533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.292519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.293110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:40.293110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.293110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:40.293110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:40.293110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:40.293110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:40.293628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.294243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:34:40.294243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.294243 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:40.294243 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.294243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.294243 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:40.294243 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.294243 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:40.295244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.295697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:40.296467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.297488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:40.298356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.298356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:40.298356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:40.298356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:40.298731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:40.299055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:40.299278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.299974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:40.299974 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.299974 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:40.299974 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.299974 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.299974 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:40.299974 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.299974 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.301138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:40.301987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:44.834858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:44.836962 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:44.873561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:44.873872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:44.874542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:44.874542 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:44.874542 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:44.874542 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:44.874542 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:44.874542 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:44.874542 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:44.874542 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:44.875751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:44.876332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:45.238469 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:45.239956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:45.240311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:45.240572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.241735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:45.241735 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.241735 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:45.241735 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.241735 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.241735 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:45.241735 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.241735 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:45.242771 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.243323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:45.286721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:45.287031 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:45.288018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:45.288322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.288993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:45.288993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.288993 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:45.288993 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.288993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.288993 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:45.288993 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.288993 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:45.289842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:45.290569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:45.290569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.290569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:45.290569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.290569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.290569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:45.290569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.290569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:45.290893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.291531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.292714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:45.292714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.292714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:45.292714 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:45.292714 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:45.293155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:45.293370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.293996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:34:45.293996 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.293996 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:45.293996 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.293996 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.293996 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:45.293996 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.293996 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:45.295043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.295936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:45.296637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.297571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:45.298237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.298237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:45.298237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:45.298765 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:45.299894 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:45.300358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:45.300590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.301436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:45.301436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.301436 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:45.301436 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.301436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.301436 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:45.301436 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.301436 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.302582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:45.303087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:49.835443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:49.836472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:49.869699 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:49.870024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:49.870906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:49.870906 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:49.870906 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:49.870906 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:49.870906 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:49.870906 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:49.870906 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:49.870906 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:49.871799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:49.872243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:50.239166 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:50.240563 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:50.241258 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:50.241258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.242115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:50.242115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.242115 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:50.242115 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.242115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.242115 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:50.242115 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.242115 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:50.244035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.244548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:50.287410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:50.287934 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:50.289248 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:50.289646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.290642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:50.290642 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.290642 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:50.290642 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.290642 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.290642 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:50.290642 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.290642 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:50.291640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:50.292217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:50.292217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.292217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:50.292217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.292217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.292217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:50.292217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.292217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:50.292721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.293195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.293966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:50.293966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.293966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:50.293966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:50.293966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:50.293966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:50.294266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.294769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:50.294769 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.294769 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:50.294769 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.294769 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.294769 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:50.294769 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.294769 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:50.295635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:50.296077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:50.296077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.296077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:50.296077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.296077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.296077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:50.296077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.296077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:50.296681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.297145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:50.297690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.297690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:50.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:50.298984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:50.299884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:50.299884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:50.299884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.300449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:50.300449 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.300449 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:50.300449 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.300449 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.300449 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:50.300449 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.300449 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.301758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:50.302377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:54.836274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:54.837857 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:54.872482 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:54.872859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:54.873704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:54.873704 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:54.873704 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:54.873704 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:54.873704 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:54.873704 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:54.873704 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:54.873704 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:54.874558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:54.875420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:55.239872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:55.241265 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:55.241703 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:55.241939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.242873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:34:55.242873 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.242873 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:55.242873 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.242873 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.242873 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:55.242873 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.242873 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:55.244647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.245516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:55.287866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:55.288413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:34:55.288912 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:55.289101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.289928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:34:55.289928 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.289928 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:55.289928 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.289928 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.289928 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:55.289928 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.289928 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:55.291880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:55.292712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:55.292712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.292712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:55.292712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.292712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.292712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:55.292712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.292712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:34:55.293585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.294350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.295167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:55.295167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.295167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:55.295167 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:55.295167 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:55.295167 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:55.295167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.295939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:34:55.295939 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.295939 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:55.295939 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.295939 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.295939 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:55.295939 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.295939 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:34:55.296688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.297076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:34:55.297719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.298173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:55.298640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.298640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:55.298945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:55.299523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:55.299840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:55.300198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:55.300429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.301121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:34:55.301121 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.301121 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:55.301121 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.301121 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.301121 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:55.301121 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.301121 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.302260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:55.302749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:34:59.836858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:34:59.837893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:34:59.871240 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:34:59.871485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:59.872240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:34:59.872240 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:59.872240 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:34:59.872240 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:34:59.872240 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:59.872240 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:34:59.872240 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:59.872240 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:59.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:34:59.875047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:00.240503 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:00.241515 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:00.241804 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:00.242006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.242657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:00.242657 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.242657 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:00.242657 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.242657 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.242657 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:00.242657 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.242657 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:00.244250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.245031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:00.288379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:00.289028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:00.289852 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:00.290259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.291031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:00.291031 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.291031 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:00.291031 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.291031 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.291031 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:00.291031 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.291031 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:00.292382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:00.293440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:00.293440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.293440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:00.293440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.293440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.293440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:00.293440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.293440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:00.294087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.294849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.295745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:00.295745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.295745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:00.295745 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:00.295745 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:00.295745 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:00.295745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.296755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:00.296755 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.296755 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:00.296755 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.296755 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.296755 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:00.296755 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.296755 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:00.297637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.298197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:00.298650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.299073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:00.299558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.299558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:00.299558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:00.299927 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:00.300363 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:00.300841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:00.301093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.302215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:00.302215 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.302215 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:00.302215 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.302215 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.302215 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:00.302215 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.302215 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.303402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:00.303987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:04.837314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:04.838669 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:04.877509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:04.878073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:04.879103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:04.879103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:04.879103 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:04.879103 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:04.879103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:04.879103 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:04.879103 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:04.879103 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:04.881187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:04.883047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:05.241077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:05.242221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:05.242522 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:05.242778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.243559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:05.243559 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.243559 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:05.243559 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.243559 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.243559 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:05.243559 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.243559 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:05.245404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.246291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:05.288963 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:05.289254 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:05.289686 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:05.289976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.290644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:05.290644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.290644 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:05.290644 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.290644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.290644 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:05.290644 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.290644 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:05.291371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.292351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:05.293471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.294432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:05.295035 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:05.295453 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:05.296034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:05.296440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.297216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:05.297216 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.297216 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:05.297216 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.297216 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.297216 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:05.297216 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.297216 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:05.298452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.299179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:05.299691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.300426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:05.301650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.301650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:05.301650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:05.301650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:05.301650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:05.301650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:05.301650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.302102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:05.302102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.302102 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:05.302102 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.302102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.302102 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:05.302102 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.302102 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.303925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:05.304425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:09.837921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:09.839212 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:09.874791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:09.875672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:09.875902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:09.875902 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:09.875902 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:09.875902 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:09.875902 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:09.875902 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:09.875902 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:09.875902 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:09.877339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:09.878562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:10.241682 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:10.242685 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:10.242954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:10.243263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.244347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:10.244347 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.244347 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:10.244347 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.244347 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.244347 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:10.244347 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.244347 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:10.245999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.246836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:10.289371 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:10.289876 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:10.290296 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:10.290545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.291083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:10.291083 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.291083 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:10.291083 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.291083 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.291083 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:10.291083 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.291083 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:10.292300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:10.293182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:10.293182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.293182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:10.293182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.293182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.293182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:10.293182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.293182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:10.293831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.294546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.295404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:10.295404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.295404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:10.295404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:10.295773 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:10.296470 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:10.296853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.297408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:10.297408 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.297408 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:10.297408 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.297408 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.297408 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:10.297408 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.297408 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:10.298869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.299844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:10.301102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.302181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:10.303157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.303157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:10.303157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:10.303157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:10.303157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:10.303157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:10.303157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.303157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:10.303653 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.303653 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:10.303653 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.303653 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.303653 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:10.303653 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.303653 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.304695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:10.305221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:14.839074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:14.841102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:14.871323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:14.871608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:14.872890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:14.872890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:14.872890 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:14.872890 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:14.872890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:14.872890 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:14.872890 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:14.872890 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:14.873340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:14.874362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:15.242675 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:15.244078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:15.244472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:15.244759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.245962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:15.245962 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.245962 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:15.245962 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.245962 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.245962 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:15.245962 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.245962 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:15.247979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.248844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:15.289933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:15.290390 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:15.290952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:15.291253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.292063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:15.292063 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.292063 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:15.292063 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.292063 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.292063 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:15.292063 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.292063 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:15.293217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:15.294069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:15.294069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.294069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:15.294069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.294069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.294069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:15.294069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.294069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:15.294754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.295497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.296394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:15.296394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.296394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:15.296394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:15.296394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:15.296701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:15.297016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.297811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:15.297811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.297811 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:15.297811 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.297811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.297811 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:15.297811 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.297811 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:15.299494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.299963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:15.301297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.301816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:15.302518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.302518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:15.302518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:15.302518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:15.302876 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:15.303185 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:15.303330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.303878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:15.303878 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.303878 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:15.303878 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.303878 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.303878 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:15.303878 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.303878 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.305094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:15.305572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:19.840029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:19.841724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:19.843294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:35:19.879295 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:19.879765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:19.880752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:19.880752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:19.880752 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:19.880752 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:19.880752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:19.880752 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:19.880752 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:19.880752 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:19.882456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:19.883476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:20.243374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:20.244600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:20.244921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:20.245131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.245992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:20.245992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.245992 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:20.245992 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.245992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.245992 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:20.245992 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.245992 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:20.247210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.247725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:20.290596 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:20.291267 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:20.291914 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:20.292224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.293095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:20.293095 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.293095 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:20.293095 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.293095 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.293095 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:20.293095 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.293095 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:20.294753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:20.295493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:20.295493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.295493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:20.295493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.295493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.295493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:20.295493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.295493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:20.296044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.296772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.297649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:20.297649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.297649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:20.297649 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:20.297649 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:20.297649 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:20.297960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.298491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:20.298491 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.298491 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:20.298491 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.298491 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.298491 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:20.298491 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.298491 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:20.299792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.300212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:20.301441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.301927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:20.302423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.302423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:20.302423 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:20.302827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:20.303314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:20.303743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:20.304012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.304815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:20.304815 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.304815 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:20.304815 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.304815 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.304815 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:20.304815 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.304815 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.306071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:20.307353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:23.318778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:23.327975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 08 13:35:23.328232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104932) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 08 13:35:23.328232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:35:23.361473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, resource={'id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'name': 'private', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['b9c480ba-80ab-475b-b935-84420037c6ca', 'd4905e6d-9f85-4996-afec-3692c12d93d1'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:10:08Z', 'updated_at': '2026-04-08T13:10:12Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21658}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.361473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.361756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c9a391e0-7fa7-4719-b96c-81fc2e60a06f, external_ids_update=None, columns={'tag': 21658}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.361756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.362156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:23.362156 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.362156 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:23.362156 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.362156 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.362156 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:23.362156 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.362156 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.362961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.363499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.364174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:35:23.364174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.364174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:35:23.364174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:35:23.391214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, resource={'id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'name': 'public', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['88cc7e33-1b68-4e35-9edc-36247de507c0', 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-08T13:10:14Z', 'updated_at': '2026-04-08T13:10:22Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.391374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.391705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-83258353-9720-4502-8be2-b82538bb4ee2, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.391859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.392223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:23.392223 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.392223 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:23.392223 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.392223 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.392223 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:23.392223 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.392223 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.393013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.393323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.393736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:35:23.393736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.393736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:35:23.393736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:35:23.419449 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, resource={'id': 'a5d505fb-12e2-4aed-8078-02b88b929c5e', 'name': 'admin_net', 'tenant_id': '98be377457d344c7834b290dc92d0dda', 'project_id': '98be377457d344c7834b290dc92d0dda', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['39438f35-bd24-4a86-8cab-99f980e8887d'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:05Z', 'updated_at': '2026-04-08T13:14:07Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 13489}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.419678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.420002 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-daf5372b-8660-44b8-b300-e46a7451059b, external_ids_update=None, columns={'tag': 13489}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.420077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.420593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:23.420593 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.420593 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:23.420593 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.420593 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.420593 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:23.420593 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.420593 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.421729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.422225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.422861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:35:23.422861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.422861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:35:23.422861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:35:23.448139 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-daec8bf3-7182-4be9-bfe4-655236471090, resource={'id': 'daec8bf3-7182-4be9-bfe4-655236471090', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['28da0a33-78ce-48f8-89df-3533da3ec3de'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:49Z', 'updated_at': '2026-04-08T13:14:49Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 54317}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.448339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-daec8bf3-7182-4be9-bfe4-655236471090, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.448624 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-4b03e103-5c09-4760-adf8-c6bbd598718a, external_ids_update=None, columns={'tag': 54317}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.448761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.449273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:23.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:23.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:23.449273 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.449273 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.450317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.450637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.451013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:35:23.451013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.451013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:35:23.451013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:35:23.529171 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, resource={'id': '71709845-924e-42fd-985e-d000e2c61286', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'enable_snat': True}, 'gw_port_id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-az3g9', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'ip_address': '172.24.5.223', 'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'}, {'ip_address': '2001:db8::19', 'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 3, 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985'}, resource_type=routers, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.529416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.529509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.529674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.529791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.530365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:23.530365 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.530365 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:23.530365 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.530365 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.530365 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:23.530365 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.530365 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:23.530770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Unable to update router 71709845-924e-42fd-985e-d000e2c61286. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 08 13:35:23.532247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:35:23.533054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:35:23.533710 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Fixing resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:35:23.639497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, resource={'id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'name': '', 'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'project_id': '', 'mac_address': 'fa:16:3e:d4:5c:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71709845-924e-42fd-985e-d000e2c61286', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164309', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.639854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5 88cc7e33-1b68-4e35-9edc-36247de507c0', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-71709845-924e-42fd-985e-d000e2c61286'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.223/24', '2001:db8::19/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.640395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=59fc94c5-b567-475a-b3a9-f77ef27251c0, lrouter_port=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:23.640800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.641668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:35:23.641668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.641668 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:23.641668 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.641668 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.641668 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:23.641668 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.641668 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Failed to fix resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.642582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:35:23.643211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:23.643934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:35:23.643934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:23.643934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:35:23.643934 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Maintenance task: Synchronization completed (took 0.31 seconds)
Apr 08 13:35:24.840947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:24.842350 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:24.879455 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:24.879705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:24.880273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:35:24.880273 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:24.880273 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:24.880273 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:24.880273 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:24.880273 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:24.880273 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:24.880273 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:24.881321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:24.881886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:25.244007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:25.245323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:25.245611 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:25.245911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.246988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:25.246988 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.246988 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:25.246988 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.246988 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.246988 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:25.246988 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.246988 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:25.248821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.249580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:25.291400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:25.291902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:25.292710 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:25.293012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.293751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:25.293751 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.293751 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:25.293751 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.293751 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.293751 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:25.293751 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.293751 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:25.294682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:25.295433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:25.295433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.295433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:25.295433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.295433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.295433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:25.295433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.295433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:25.295868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.296645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.297664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:25.297664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.297664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:25.297664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:25.297664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:25.297664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:25.298013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.298870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:25.298870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.298870 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:25.298870 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.298870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.298870 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:25.298870 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.298870 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:25.300234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.300818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:25.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.302963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:25.303405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.303405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:25.303405 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:25.303405 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:25.303797 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:25.304028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:25.304280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.304754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:25.304754 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.304754 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:25.304754 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.304754 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.304754 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:25.304754 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.304754 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.305920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:25.306390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:29.842016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:29.845281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:29.884331 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:29.884885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:29.885993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:35:29.885993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:29.885993 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:29.885993 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:29.885993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:29.885993 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:29.885993 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:29.885993 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:29.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:29.887764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:30.244711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:30.246811 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:30.247357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:30.247799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.248988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:30.248988 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.248988 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:30.248988 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.248988 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.248988 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:30.248988 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.248988 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:30.250872 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.251600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:30.291938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:30.292872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:30.293970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:30.294356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.295597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:30.295597 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.295597 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:30.295597 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.295597 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.295597 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:30.295597 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.295597 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:30.297198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:30.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:30.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:30.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:30.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.298548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:30.299215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.300322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.301483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:30.301483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.301483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:30.301483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:30.301483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:30.301483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:30.302016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.302870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:30.302870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.302870 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:30.302870 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.302870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.302870 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:30.302870 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.302870 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:30.304273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:30.304734 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:30.306175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.306512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:30.306984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.306984 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:30.306984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:30.307064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:30.307385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:30.307677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.309086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:30.309086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.309086 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:30.309086 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.309086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.309086 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:30.309086 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.309086 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.310768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:30.311245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:34.842719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:34.843822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:34.880455 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:34.880906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:34.881994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:35:34.881994 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:34.881994 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:34.881994 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:34.881994 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:34.881994 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:34.881994 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:34.881994 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:34.883924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:34.885032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:35.245409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:35.247080 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:35.247316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:35.247513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.248374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:35.248374 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.248374 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:35.248374 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.248374 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.248374 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:35.248374 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.248374 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:35.250166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.250688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:35.292795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:35.293086 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:35.293978 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:35.294180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.294796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:35.294796 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.294796 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:35.294796 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.294796 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.294796 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:35.294796 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.294796 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:35.295630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:35.296131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:35.296131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.296131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:35.296131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.296131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.296131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:35.296131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.296131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:35.296529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.297026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.297505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:35.297505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.297505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:35.300531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:35.301132 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:35.301701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:35.302086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.302827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:35.302827 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.302827 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:35.302827 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.302827 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.302827 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:35.302827 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.302827 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:35.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.304517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:35.306022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.306423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:35.306817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.306817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:35.306817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:35.306817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:35.306993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:35.307203 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:35.307356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.307824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:35.307824 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.307824 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:35.307824 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.307824 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.307824 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:35.307824 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.307824 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.309043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:35.309463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:39.843260 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:39.845056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:39.878555 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:39.879061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:39.880140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:35:39.880140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:39.880140 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:39.880140 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:39.880140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:39.880140 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:39.880140 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:39.880140 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:39.881115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:39.881717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:40.246193 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:40.247791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:40.248361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:40.248772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.250693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:40.250693 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.250693 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:40.250693 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.250693 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.250693 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:40.250693 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.250693 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:40.251649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.252436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:40.293513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:40.294067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:40.295085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:40.295402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.296216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:40.296216 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.296216 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:40.296216 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.296216 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.296216 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:40.296216 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.296216 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:40.297624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:40.298268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:40.298268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.298268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:40.298268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.298268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.298268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:40.298268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.298268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:40.299413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.300099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.300704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:40.300704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.300704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:40.301019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:40.301484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:40.302074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:40.302400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.303110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:40.303110 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.303110 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:40.303110 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.303110 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.303110 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:40.303110 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.303110 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:40.304506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.305001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:40.306309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.306942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:40.307466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.307466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:40.307466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:40.307466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:40.307632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:40.308067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:40.308464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.309287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:40.309287 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.309287 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:40.309287 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.309287 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.309287 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:40.309287 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.309287 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.310591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:40.311110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:44.844186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:44.845554 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:44.874700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:44.874959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:44.875882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:35:44.875882 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:44.875882 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:44.875882 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:44.875882 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:44.875882 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:44.875882 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:44.875882 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:44.876655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:44.877701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:45.246791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:45.248104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:45.248374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:45.248536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.249336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:45.249336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.249336 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:45.249336 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.249336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.249336 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:45.249336 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.249336 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:45.251158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.251977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:45.294263 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:45.294729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:45.295266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:45.295662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.296416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:45.296416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.296416 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:45.296416 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.296416 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.296416 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:45.296416 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.296416 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:45.297737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:45.298558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:45.298558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.298558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:45.298558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.298558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.298558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:45.298558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.298558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:45.299228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.300063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.300942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:45.300942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.300942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:45.301469 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:45.301851 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:45.302307 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:45.302651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.303366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:45.303366 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.303366 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:45.303366 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.303366 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.303366 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:45.303366 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.303366 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:45.304191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.304643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:45.305201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.305700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:45.306212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.306212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:45.307059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:45.307859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:45.308328 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:45.308697 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:45.308917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.309758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:45.309758 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.309758 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:45.309758 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.309758 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.309758 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:45.309758 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.309758 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.311632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:45.312195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:49.844904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:49.846461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:49.884170 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:49.884728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:49.885739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:35:49.885739 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:49.885739 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:49.885739 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:49.885739 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:49.885739 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:49.885739 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:49.885739 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:49.886877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:49.888202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:50.247545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:50.248990 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:50.249402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:50.249714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.250892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:50.250892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.250892 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:50.250892 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.250892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.250892 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:50.250892 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.250892 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:50.252757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.253524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:50.294884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:50.295233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:50.295827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:50.296102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.296855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:50.296855 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.296855 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:50.296855 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.296855 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.296855 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:50.296855 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.296855 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:50.298059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:50.298999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:50.298999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.298999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:50.298999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.298999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.298999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:50.298999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.298999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:50.299773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.300565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.301649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:50.301649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.301649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:50.301952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:50.302438 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:50.302942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:50.303399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.304097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:50.304097 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.304097 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:50.304097 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.304097 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.304097 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:50.304097 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.304097 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:50.304981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.305407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:50.306053 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.306522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:50.307047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.307047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:50.307527 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:50.307915 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:50.308313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:50.308747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:50.308913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.309659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:50.309659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.309659 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:50.309659 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.309659 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.309659 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:50.309659 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.309659 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.310969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:50.312142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:54.845542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:54.847213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:54.881089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:54.882863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:54.884133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:35:54.884133 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:54.884133 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:54.884133 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:54.884133 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:54.884133 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:54.884133 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:54.884133 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:54.885369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:54.886268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:55.248528 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:55.249947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:55.250726 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:55.250726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.251160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:35:55.251160 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.251160 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:55.251160 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.251160 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.251160 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:55.251160 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.251160 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:55.253245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.254050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:55.295442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:55.296065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:35:55.296725 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:55.297414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.297889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:35:55.297889 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.297889 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:55.297889 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.297889 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.297889 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:55.297889 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.297889 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:55.299405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:55.300235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:55.300235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.300235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:55.300235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.300235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.300235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:55.300235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.300235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:35:55.301276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.302062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.302979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:55.302979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.302979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:55.302979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:55.302979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:55.303501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:55.304011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.304860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:35:55.304860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.304860 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:55.304860 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.304860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.304860 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:55.304860 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.304860 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:35:55.305934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.306365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:35:55.306985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.307405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:55.307905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.307905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:55.307971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:55.308490 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:55.308797 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:55.309280 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:55.309427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.309985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:35:55.309985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.309985 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:55.309985 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.309985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.309985 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:55.309985 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.309985 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.312154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:55.312736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:35:59.846297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:35:59.847406 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:35:59.884465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:35:59.884887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:59.885870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:35:59.885870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:59.885870 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:35:59.885870 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:35:59.885870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:59.885870 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:35:59.885870 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:59.885870 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:59.887227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:35:59.888093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:00.249174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:00.250686 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:00.251117 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:00.251412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.252437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:00.252437 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.252437 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:00.252437 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.252437 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.252437 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:00.252437 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.252437 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:00.253792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.254242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:00.296314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:00.296749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:00.297570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:00.298023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.299176 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:00.299176 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.299176 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:00.299176 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.299176 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.299176 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:00.299176 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.299176 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:00.300447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:00.301353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:00.301353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.301353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:00.301353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.301353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.301353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:00.301353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.301353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:00.302063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.302838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.303736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:00.303736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.303736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:00.303736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:00.303736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:00.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:00.304052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.304648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:00.304648 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.304648 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:00.304648 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.304648 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.304648 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:00.304648 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.304648 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:00.306018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.306791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:00.308021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.308470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:00.309007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.309007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:00.309007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:00.309007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:00.309692 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:00.309969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:00.310128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.310892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:00.310892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.310892 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:00.310892 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.310892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.310892 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:00.310892 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.310892 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.312714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:00.313224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:04.846911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:04.848548 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:04.879610 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:04.879941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:04.880721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:04.880721 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:04.880721 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:04.880721 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:04.880721 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:04.880721 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:04.880721 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:04.880721 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:04.881510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:04.882448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:05.249994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:05.250938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:05.251153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:05.251348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.252202 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:05.252202 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.252202 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:05.252202 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.252202 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.252202 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:05.252202 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.252202 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:05.253964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.254978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:05.297061 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:05.297622 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:05.298301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:05.298301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.299086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:05.299086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.299086 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:05.299086 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.299086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.299086 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:05.299086 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.299086 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:05.300194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:05.301029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:05.301029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.301029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:05.301029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.301029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.301029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:05.301029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.301029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:05.301800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.302522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.303309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:05.303309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.303309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:05.303446 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:05.303981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:05.304382 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:05.304623 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.305246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:05.305246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.305246 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:05.305246 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.305246 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.305246 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:05.305246 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.305246 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:05.306496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.306982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:05.308134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.308600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:05.309175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.309175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:05.309175 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:05.309175 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:05.309376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:05.309585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:05.309750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.310233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:05.310233 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.310233 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:05.310233 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.310233 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.310233 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:05.310233 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.310233 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.311353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:05.311839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:09.847461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:09.849100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:09.888580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:09.889064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:09.890181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:09.890181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:09.890181 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:09.890181 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:09.890181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:09.890181 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:09.890181 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:09.890181 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:09.891305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:09.892027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:10.250642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:10.254848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:10.255231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:10.255494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.256317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:10.256317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.256317 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:10.256317 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.256317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.256317 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:10.256317 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.256317 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:10.257394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.257882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:10.298592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:10.298794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:10.299569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:10.299914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.300799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:10.300799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.300799 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:10.300799 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.300799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.300799 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:10.300799 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.300799 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:10.301673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:10.302284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:10.302284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.302284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:10.302284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.302284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.302284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:10.302284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.302284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:10.302632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.303014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.303476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:10.303476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.303476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:10.303744 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:10.304114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:10.304636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:10.305159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.306221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:10.306221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.306221 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:10.306221 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.306221 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.306221 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:10.306221 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.306221 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:10.306759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.307104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:10.307488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.307854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:10.308203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.308203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:10.309054 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:10.309357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:10.309784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:10.310104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:10.310318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.311002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:10.311002 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.311002 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:10.311002 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.311002 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.311002 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:10.311002 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.311002 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.311994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:10.312314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:14.848084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:14.849166 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:14.885503 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:14.885800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:14.886645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:14.886645 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:14.886645 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:14.886645 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:14.886645 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:14.886645 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:14.886645 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:14.886645 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:14.887434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:14.888013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:15.254344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:15.255403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:15.255591 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:15.255726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.256422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:15.256422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.256422 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:15.256422 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.256422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.256422 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:15.256422 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.256422 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:15.258247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.259171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:15.298960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:15.299330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:15.299921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.300776 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:15.301223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:15.301584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:15.301584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.301584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:15.301584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.301584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.301584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:15.301584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.301584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:15.301941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.302362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.302733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:15.302733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.302733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:15.304114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:15.304500 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:15.305129 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:15.305129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.305240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:15.305240 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.305240 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:15.305240 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.305240 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.305240 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:15.305240 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.305240 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:15.306004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.306443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:15.306918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.307358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:15.307849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.307849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:15.309456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:15.310025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:15.310344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:15.310689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:15.310944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.311677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:15.311677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.311677 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:15.311677 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.311677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.311677 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:15.311677 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.311677 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.314027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:15.314519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:19.848697 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:19.850302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:19.851971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=434 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:36:19.885247 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:19.885831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:19.886721 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:19.886721 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:19.886721 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:19.886721 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:19.886721 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:19.886721 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:19.886721 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:19.886721 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:19.887652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:19.888117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:20.254786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:20.255630 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:20.255835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:20.255949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.256473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:20.256473 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.256473 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:20.256473 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.256473 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.256473 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:20.256473 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.256473 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:20.257515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.258011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:20.299403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:20.299653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:20.300316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:20.300542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.301632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:20.301632 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.301632 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:20.301632 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.301632 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.301632 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:20.301632 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.301632 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:20.302724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:20.303503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:20.303503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.303503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:20.303503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.303503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.303503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:20.303503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.303503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:20.304447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.305794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:20.307456 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.307776 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.307776 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:20.307776 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.307776 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:20.308520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.309468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:20.310539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.310988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:20.311417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.311417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:20.311417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:20.311417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:20.311710 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:20.312065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:20.312352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.313040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:20.313040 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.313040 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:20.313040 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.313040 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.313040 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:20.313040 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.313040 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.313907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:20.314339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:24.849415 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:24.851259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:24.886449 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:24.886767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:24.887154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:24.887154 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:24.887154 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:24.887154 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:24.887154 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:24.887154 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:24.887154 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:24.887154 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:24.888039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:24.889081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:25.255534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:25.256840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:25.257355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:25.257597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.258471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:25.258471 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.258471 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:25.258471 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.258471 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.258471 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:25.258471 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.258471 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:25.259804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.260567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:25.300115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:25.300464 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:25.301274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:25.301592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.302398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:25.302398 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.302398 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:25.302398 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.302398 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.302398 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:25.302398 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.302398 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:25.303748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:25.304523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:25.304523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.304523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:25.304523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.304523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.304523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:25.304523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.304523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:25.305413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.307004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:25.307004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.307004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:25.307004 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:25.307271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:25.308431 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:25.308431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.309336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:25.309336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.309336 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:25.309336 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.309336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.309336 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:25.309336 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.309336 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:25.310862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.311588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:25.312953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.313946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:25.314922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.314922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:25.314922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:25.314922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:25.314922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:25.314922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:25.314922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.315328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:25.315328 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.315328 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:25.315328 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.315328 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.315328 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:25.315328 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.315328 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.316471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:25.317386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:29.850032 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:29.851486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:29.881818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:29.882229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:29.883173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:29.883173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:29.883173 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:29.883173 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:29.883173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:29.883173 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:29.883173 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:29.883173 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:29.884366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:29.884929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:30.256229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:30.257593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:30.257991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:30.258250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.259474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:30.259474 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.259474 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:30.259474 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.259474 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.259474 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:30.259474 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.259474 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:30.261647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.262351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:30.300893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:30.301419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:30.302146 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:30.302453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.303315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:30.303315 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.303315 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:30.303315 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.303315 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.303315 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:30.303315 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.303315 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:30.304531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:30.305468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:30.305468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.305468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:30.305468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.305468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.305468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:30.305468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.305468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:30.306055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.306874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.307570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:30.307570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.307570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:30.307570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:30.307729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:30.308124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:30.308492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.309254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:30.309254 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.309254 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:30.309254 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.309254 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.309254 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:30.309254 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.309254 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:30.310510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.311015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:30.311910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.312341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:30.312832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.312832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:30.313439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:30.314132 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:30.314462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:30.314704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:30.314859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.315481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:30.315481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.315481 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:30.315481 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.315481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.315481 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:30.315481 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.315481 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.317718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:30.318203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:34.850660 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:34.852299 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:34.894563 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:34.894823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:34.895528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:34.895528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:34.895528 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:34.895528 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:34.895528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:34.895528 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:34.895528 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:34.895528 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:34.896640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:34.897234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:35.280176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:35.280464 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:35.280779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:35.280935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:35.281546 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.281546 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:35.281546 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.281546 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.281546 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:35.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.281546 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:35.282443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.282901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:35.301468 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:35.301885 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:35.302316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:35.302516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.303114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:35.303114 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.303114 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:35.303114 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.303114 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.303114 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:35.303114 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.303114 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:35.304276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:35.305087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:35.305087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.305087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:35.305087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.305087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.305087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:35.305087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.305087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:35.305788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.306961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.307773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:35.307773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.307773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:35.307773 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:35.308063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:35.308353 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:35.308576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.309102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:35.309102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.309102 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:35.309102 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.309102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.309102 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:35.309102 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.309102 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:35.309964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.310830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:35.311266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.311826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:35.312322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.312322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:35.313931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:35.314463 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:35.314889 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:35.315103 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:35.315643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.315871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:35.315871 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.315871 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:35.315871 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.315871 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.315871 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:35.315871 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.315871 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.317725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:35.318265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:39.851221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:39.852430 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:39.887495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:39.888363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:39.889294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:39.889294 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:39.889294 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:39.889294 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:39.889294 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:39.889294 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:39.889294 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:39.889294 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:39.890586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:39.891446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:40.280045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:40.281287 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:40.281645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:40.281932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.282999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:40.282999 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.282999 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:40.282999 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.282999 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.282999 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:40.282999 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.282999 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:40.284288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.285011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:40.301913 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:40.302299 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:40.302831 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:40.303165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.303950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:40.303950 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.303950 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:40.303950 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.303950 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.303950 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:40.303950 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.303950 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:40.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.403928 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:40.404938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:40.405401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:40.405711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.406007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.406406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:40.406733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:40.407099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:40.407293 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:40.407654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:40.408020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:40.408020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:40.408020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:40.408020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:40.408020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:40.408020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:44.851896 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:44.853241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:44.885914 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:44.886352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:44.887262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:44.887262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:44.887262 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:44.887262 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:44.887262 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:44.887262 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:44.887262 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:44.887262 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:44.888162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:44.888934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:45.280837 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:45.282320 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:45.282534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:45.282769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.283672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:45.283672 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.283672 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:45.283672 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.283672 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.283672 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:45.283672 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.283672 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:45.285727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.286472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:45.302368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:45.303252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:45.303507 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:45.304010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.304606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:45.304606 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.304606 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:45.304606 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.304606 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.304606 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:45.304606 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.304606 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:45.305751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:45.306634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:45.306634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.306634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:45.306634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.306634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.306634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:45.306634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.306634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:45.307325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.308306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.309592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:45.309592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.309592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:45.309592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:45.309592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:45.309592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:45.309994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.310346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:45.310346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.310346 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:45.310346 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.310346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.310346 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:45.310346 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.310346 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:45.311253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.312092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:45.312456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.312946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:45.313519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.313519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:45.314872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:45.315326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:45.315531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:45.315759 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:45.315921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.316561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:45.316561 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.316561 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:45.316561 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.316561 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.316561 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:45.316561 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.316561 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.317426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:45.317997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:49.852537 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:49.854200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:49.895356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:49.895578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:49.896406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:49.896406 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:49.896406 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:49.896406 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:49.896406 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:49.896406 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:49.896406 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:49.896406 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:49.897791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:49.898740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:50.281536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:50.282842 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:50.283246 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:50.283589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.284455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:50.284455 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.284455 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:50.284455 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.284455 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.284455 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:50.284455 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.284455 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:50.285567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.286314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:50.302875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:50.303256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:50.303763 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:50.304111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.304918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:50.304918 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.304918 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:50.304918 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.304918 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.304918 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:50.304918 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.304918 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:50.306315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:50.307394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:50.307394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.307394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:50.307394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.307394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.307394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:50.307394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.307394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:50.308355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.309262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.310343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:50.310343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.310343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:50.310343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:50.310343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:50.310343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:50.310867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.311123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:50.311123 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.311123 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:50.311123 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.311123 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.311123 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:50.311123 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.311123 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:50.312286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.312718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:50.313671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.314301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:50.314802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.314802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:50.315297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:50.315843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:50.316136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:50.316389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:50.316530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.317011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:50.317011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.317011 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:50.317011 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.317011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.317011 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:50.317011 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.317011 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.317985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:50.318451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:54.853195 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:54.854241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:54.880479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:54.880940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:54.881716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:54.881716 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:54.881716 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:54.881716 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:54.881716 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:54.881716 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:54.881716 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:54.881716 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:54.882889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:54.883714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:55.282274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:55.283484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:55.283742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:55.283949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.284737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:36:55.284737 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.284737 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:55.284737 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.284737 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.284737 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:55.284737 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.284737 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:55.286506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.287243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:55.303344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:55.303727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:36:55.304101 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:55.304324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.304773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:36:55.304773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.304773 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:55.304773 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.304773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.304773 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:55.304773 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.304773 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:55.305518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:55.306412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:55.306412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.306412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:55.306412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.306412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.306412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:55.306412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.306412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:36:55.306786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.307314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.307852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:55.307852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.307852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:55.309536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:55.310578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:55.311052 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:55.311559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.312302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:36:55.312302 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.312302 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:55.312302 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.312302 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.312302 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:55.312302 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.312302 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:36:55.313135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.313655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:36:55.314219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.314695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:55.315223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.315223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:55.315825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:55.316583 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:55.316957 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:55.317255 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:55.317417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.318061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:36:55.318061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.318061 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:55.318061 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.318061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.318061 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:55.318061 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.318061 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.319356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:55.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:36:59.853913 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:36:59.856209 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:36:59.888742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:36:59.888742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:59.889533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:36:59.889533 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:59.889533 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:36:59.889533 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:36:59.889533 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:59.889533 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:36:59.889533 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:59.889533 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:59.890455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:36:59.891242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:00.282954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:00.284310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:00.284835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:00.285119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.286227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:00.286227 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.286227 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:00.286227 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.286227 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.286227 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:00.286227 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.286227 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:00.287630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.288360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:00.303812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:00.304295 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:00.304959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:00.305370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.306218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:00.306218 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.306218 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:00.306218 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.306218 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.306218 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:00.306218 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.306218 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:00.307749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:00.308282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:00.308282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.308282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:00.308282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.308282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.308282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:00.308282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.308282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:00.309791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.310342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.310881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:00.310881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.310881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:00.310881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:00.311481 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:00.312077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:00.312439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.313345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:00.313345 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.313345 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:00.313345 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.313345 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.313345 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:00.313345 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.313345 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:00.314852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.315317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:00.318269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.318820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:00.319381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.319381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:00.319381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:00.319381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:00.319524 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:00.319692 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:00.319749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.322076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:00.322076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.322076 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:00.322076 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.322076 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.322076 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:00.322076 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.322076 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.323806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:00.324347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:04.854486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:04.855952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:04.895400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:04.895709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:04.896350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:04.896350 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:04.896350 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:04.896350 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:04.896350 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:04.896350 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:04.896350 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:04.896350 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:04.897239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:04.897768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:05.283759 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:05.284638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:05.284909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:05.285078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.285892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:05.285892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.285892 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:05.285892 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.285892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.285892 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:05.285892 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.285892 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:05.287150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.288031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:05.304325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:05.304763 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:05.305142 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:05.305354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.305892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:05.305892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.305892 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:05.305892 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.305892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.305892 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:05.305892 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.305892 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:05.306907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:05.307662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:05.307662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.307662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:05.307662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.307662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.307662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:05.307662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.307662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:05.308264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.308845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.309354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:05.309354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.309354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:05.311282 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:05.311678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:05.312205 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:05.312537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.313337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:05.313337 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.313337 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:05.313337 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.313337 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.313337 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:05.313337 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.313337 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:05.314141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.314583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:05.315222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.315684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:05.316219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.316219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:05.318799 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:05.319435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:05.319870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:05.320125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:05.320274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.320934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:05.320934 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.320934 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:05.320934 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.320934 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.320934 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:05.320934 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.320934 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.322921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:05.323393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:09.855312 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:09.856973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:09.891594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:09.892085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:09.893052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:09.893052 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:09.893052 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:09.893052 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:09.893052 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:09.893052 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:09.893052 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:09.893052 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:09.894158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:09.895154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:10.284450 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:10.285805 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:10.286197 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:10.286414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.287601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:10.287601 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.287601 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:10.287601 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.287601 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.287601 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:10.287601 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.287601 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:10.289537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.290260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:10.304875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:10.305253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:10.305743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:10.306049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.306754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:10.306754 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.306754 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:10.306754 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.306754 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.306754 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:10.306754 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.306754 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:10.308111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:10.308963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:10.308963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.308963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:10.308963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.308963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.308963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:10.308963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.308963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:10.310544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.311673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.312486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:10.312486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.312486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:10.312486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:10.312721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:10.313440 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:10.313995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.314905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:10.314905 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.314905 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:10.314905 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.314905 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.314905 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:10.314905 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.314905 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:10.316435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.316989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:10.317675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.318124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:10.318627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.318627 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:10.319237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:10.319888 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:10.320423 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:10.320836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:10.321072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.321886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:10.321886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.321886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:10.321886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.321886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.321886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:10.321886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.321886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.323527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:10.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:14.856093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:14.857872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:14.899941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:14.900213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:14.900975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:14.900975 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:14.900975 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:14.900975 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:14.900975 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:14.900975 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:14.900975 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:14.900975 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:14.902212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:14.903141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:15.286242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:15.287741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:15.288205 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:15.288558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.289682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:15.289682 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.289682 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:15.289682 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.289682 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.289682 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:15.289682 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.289682 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:15.291123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.291594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:15.305345 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:15.306151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:15.306666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:15.307110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.308277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:15.308277 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.308277 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:15.308277 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.308277 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.308277 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:15.308277 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.308277 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:15.309728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:15.310826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:15.310826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.310826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:15.310826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.310826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.310826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:15.310826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.310826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:15.311220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.312015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.312932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:15.312932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.312932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:15.312932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:15.313138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:15.313680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:15.314177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.315112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:15.315112 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.315112 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:15.315112 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.315112 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.315112 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:15.315112 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.315112 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:15.316412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.316963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:15.318502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.319039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:15.319781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.319781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:15.319781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:15.320363 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:15.321206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:15.321206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:15.321206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.321828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:15.321828 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.321828 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:15.321828 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.321828 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.321828 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:15.321828 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.321828 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.323435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:15.325181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:19.856950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:19.858644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:19.860717 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:37:19.893210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:19.893350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:19.894225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:19.894225 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:19.894225 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:19.894225 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:19.894225 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:19.894225 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:19.894225 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:19.894225 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:19.895741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:19.896535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:20.287103 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:20.288920 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:20.289277 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:20.289633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.290807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:20.290807 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.290807 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:20.290807 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.290807 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.290807 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:20.290807 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.290807 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:20.292783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.293491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:20.305827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:20.306092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:20.306651 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:20.307095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.307883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:20.307883 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.307883 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:20.307883 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.307883 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.307883 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:20.307883 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.307883 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:20.308815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:20.309863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:20.309863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.309863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:20.309863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.309863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.309863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:20.309863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.309863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:20.310419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.311316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.312128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:20.312128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.312128 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:20.313067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:20.313784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:20.314313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:20.314720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.315486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:20.315486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.315486 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:20.315486 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.315486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.315486 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:20.315486 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.315486 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:20.317003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.317707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:20.318906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.319847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:20.320651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.320651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:20.320651 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:20.320812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:20.321340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:20.321777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:20.322000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.322976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:20.322976 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.322976 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:20.322976 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.322976 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.322976 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:20.322976 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.322976 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.324939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:20.325855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:24.857602 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:24.859232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:24.895188 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:24.934072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:24.934657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:24.934657 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:24.934657 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:24.934657 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:24.934657 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:24.934657 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:24.934657 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:24.934657 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:24.935730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:24.936149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:25.288112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:25.289671 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:25.290378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:25.290378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.291098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:25.291098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.291098 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:25.291098 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.291098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.291098 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:25.291098 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.291098 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:25.292850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.293912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:25.306257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:25.306713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:25.307271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:25.307541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.308380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:25.308380 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.308380 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:25.308380 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.308380 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.308380 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:25.308380 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.308380 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:25.309752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:25.311071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:25.311071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.311071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:25.311071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.311071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.311071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:25.311071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.311071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:25.311608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.312361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.313282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:25.313282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.313282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:25.313564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:25.314043 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:25.314851 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:25.314851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.315570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:25.315570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.315570 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:25.315570 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.315570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.315570 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:25.315570 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.315570 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:25.316337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.316825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:25.317602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.318048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:25.318550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.318550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:25.320572 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:25.321179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:25.321721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:25.322084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:25.322336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.323106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:25.323106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.323106 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:25.323106 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.323106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.323106 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:25.323106 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.323106 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.325009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:25.325462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:29.858297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:29.859791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:29.894751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:29.895190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:29.896261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:29.896261 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:29.896261 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:29.896261 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:29.896261 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:29.896261 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:29.896261 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:29.896261 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:29.897353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:29.898124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:30.288848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:30.290854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:30.291196 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:30.291437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.292420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:30.292420 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.292420 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:30.292420 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.292420 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.292420 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:30.292420 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.292420 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:30.294536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.295096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:30.306782 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:30.307304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:30.307917 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:30.308223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.308975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:30.308975 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.308975 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:30.308975 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.308975 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.308975 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:30.308975 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.308975 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:30.310303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:30.311461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:30.311461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.311461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:30.311461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.311461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.311461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:30.311461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.311461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:30.312095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.314485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:30.314485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.314485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:30.314485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:30.314485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:30.314996 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:30.315338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.316061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:30.316061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.316061 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:30.316061 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.316061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.316061 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:30.316061 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.316061 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:30.316934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.317666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:30.318096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.318781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:30.319440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.319440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:30.321114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:30.321494 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:30.321964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:30.322394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:30.322605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.323564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:30.323564 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.323564 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:30.323564 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.323564 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.323564 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:30.323564 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.323564 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.324893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:30.325529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:34.859105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:34.860598 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:34.895903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:34.896490 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:34.897485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:34.897485 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:34.897485 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:34.897485 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:34.897485 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:34.897485 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:34.897485 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:34.897485 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:34.898808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:34.899227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:35.289864 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:35.291187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:35.291603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:35.291939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.292948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:35.292948 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.292948 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:35.292948 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.292948 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.292948 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:35.292948 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.292948 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:35.294779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.295583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:35.307198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:35.307626 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:35.308323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:35.308681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.309547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:35.309547 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.309547 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:35.309547 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.309547 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.309547 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:35.309547 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.309547 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:35.310403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:35.310932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:35.310932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.310932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:35.310932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.310932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.310932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:35.310932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.310932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:35.311365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.311965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.312671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:35.312671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.312671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:35.314487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:35.315171 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:35.315916 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:35.316398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.317251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:35.317251 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.317251 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:35.317251 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.317251 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.317251 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:35.317251 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.317251 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:35.318548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.318961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:35.320855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.321338 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:35.321884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.321884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:35.321884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:35.321991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:35.322394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:35.322629 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:35.322836 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.323472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:35.323472 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.323472 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:35.323472 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.323472 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.323472 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:35.323472 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.323472 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.325096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:35.325703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:39.859659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:39.861426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:39.897318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:39.897534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:39.897916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:39.897916 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:39.897916 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:39.897916 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:39.897916 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:39.897916 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:39.897916 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:39.897916 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:39.898728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:39.899575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:40.291134 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:40.291871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:40.292457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:40.292807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.294013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:40.294013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.294013 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:40.294013 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.294013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.294013 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:40.294013 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.294013 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:40.296195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.296767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:40.307630 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:40.308060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:40.308781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:40.309102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.309837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:40.309837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.309837 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:40.309837 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.309837 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.309837 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:40.309837 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.309837 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:40.310816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:40.311188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:40.311188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.311188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:40.311188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.311188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.311188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:40.311188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.311188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:40.312020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.312334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.312684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:40.312684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.312684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:40.315062 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:40.315510 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:40.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:40.316397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.317324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:40.317324 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.317324 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:40.317324 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.317324 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.317324 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:40.317324 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.317324 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:40.318907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.319215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:40.320874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.321191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:40.321537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.321537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:40.321998 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:40.322537 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:40.323033 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:40.323492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:40.324140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.324787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:40.324787 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.324787 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:40.324787 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.324787 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.324787 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:40.324787 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.324787 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.325534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:40.326231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:44.860387 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:44.861853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:44.902598 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:44.902867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:44.903486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:44.903486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:44.903486 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:44.903486 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:44.903486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:44.903486 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:44.903486 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:44.903486 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:44.906569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:44.907188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:45.291192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:45.292717 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:45.293054 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:45.293239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.294097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:45.294097 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.294097 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:45.294097 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.294097 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.294097 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:45.294097 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.294097 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:45.295894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.296678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:45.308094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:45.308701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:45.309206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:45.309418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:45.309997 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.309997 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:45.309997 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.309997 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.309997 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:45.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:45.311366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:45.311960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:45.311960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.311960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:45.311960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.311960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.311960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:45.311960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.311960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:45.312978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.313901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.314722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:45.314722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.314722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:45.315563 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:45.316699 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:45.317265 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:45.317763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.318385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:45.318385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.318385 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:45.318385 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.318385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.318385 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:45.318385 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.318385 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:45.319270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.320088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:45.320545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.321320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:45.322257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.322257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:45.322502 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:45.322959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:45.323572 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:45.324046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:45.324713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.325267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:45.325267 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.325267 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:45.325267 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.325267 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.325267 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:45.325267 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.325267 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.326894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:45.327402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:49.861009 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:49.862961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:49.898519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:49.898714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:49.899244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:49.899244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:49.899244 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:49.899244 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:49.899244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:49.899244 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:49.899244 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:49.899244 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:49.900121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:49.900801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:50.292063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:50.293457 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:50.293926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:50.294190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.295332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:50.295332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.295332 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:50.295332 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.295332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.295332 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:50.295332 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.295332 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:50.296693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.297710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:50.308510 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:50.309159 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:50.310130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:50.310455 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.311507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:50.311507 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.311507 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:50.311507 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.311507 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.311507 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:50.311507 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.311507 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:50.313121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:50.314082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:50.314082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.314082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:50.314082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.314082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.314082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:50.314082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.314082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:50.315335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.316178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.317151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:50.317151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.317151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:50.317151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:50.317151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:50.317462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:50.317680 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.318630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:50.318630 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.318630 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:50.318630 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.318630 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.318630 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:50.318630 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.318630 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:50.320073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.320497 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:50.321908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.322373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:50.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:50.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:50.323156 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:50.323498 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:50.323766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:50.323920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.324480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:50.324480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.324480 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:50.324480 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.324480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.324480 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:50.324480 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.324480 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.325624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:50.326085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:54.861651 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:54.863318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:54.898573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:54.898979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:54.900003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:54.900003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:54.900003 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:54.900003 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:54.900003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:54.900003 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:54.900003 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:54.900003 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:54.901200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:54.901700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:55.292991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:55.294990 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:55.295406 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:55.295768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.296995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:37:55.296995 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.296995 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:55.296995 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.296995 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.296995 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:55.296995 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.296995 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:55.298990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.300229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:55.309110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:55.309505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:37:55.310267 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:55.310631 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.311448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:37:55.311448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.311448 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:55.311448 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.311448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.311448 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:55.311448 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.311448 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:55.313078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:55.314378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:55.314378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.314378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:55.314378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.314378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.314378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:55.314378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.314378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:37:55.315018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.316074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.317099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:55.317099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.317099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:55.317099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:55.317099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:55.317472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:55.317894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.318709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:37:55.318709 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.318709 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:55.318709 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.318709 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.318709 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:55.318709 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.318709 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:37:55.319885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.320590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:37:55.321575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.322486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:55.323758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.323758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:55.323758 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:55.324001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:55.324294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:55.325317 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:55.325317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.325589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:37:55.325589 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.325589 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:55.325589 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.325589 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.325589 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:55.325589 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.325589 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.327288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:55.328110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:37:59.862356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:37:59.863782 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:37:59.895310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:37:59.895480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:59.895922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:37:59.895922 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:59.895922 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:37:59.895922 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:37:59.895922 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:59.895922 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:37:59.895922 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:59.895922 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:59.896695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:37:59.897203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:00.294042 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:00.295700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:00.296143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:00.296533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.297833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:00.297833 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.297833 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:00.297833 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.297833 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.297833 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:00.297833 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.297833 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:00.299766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:00.309535 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:00.310153 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:00.310636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:00.310895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.311418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:00.311418 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.311418 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:00.311418 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.311418 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.311418 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:00.311418 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.311418 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:00.312645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:00.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:00.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:00.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:00.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:00.314309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.315077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.315979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:00.315979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.315979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:00.316857 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:00.317505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:00.318180 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:00.318760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.320226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:00.320226 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.320226 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:00.320226 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.320226 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.320226 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:00.320226 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.320226 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:00.321160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.321949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:00.322670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.323582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:00.324741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.324741 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:00.324741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:00.324741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:00.325279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:00.325584 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:00.325770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.326457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:00.326457 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.326457 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:00.326457 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.326457 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.326457 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:00.326457 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.326457 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.327534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:00.328014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:04.863074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:04.864194 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:04.898842 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:04.899094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:04.899696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:04.899696 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:04.899696 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:04.899696 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:04.899696 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:04.899696 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:04.899696 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:04.899696 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:04.901007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:04.901781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:05.294685 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:05.296090 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:05.296465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:05.296799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.298016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:05.298016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.298016 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:05.298016 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.298016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.298016 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:05.298016 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.298016 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:05.299864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.300694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:05.310203 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:05.310582 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:05.311224 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:05.311540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.312545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:05.312545 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.312545 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:05.312545 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.312545 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.312545 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:05.312545 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.312545 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:05.315005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:05.315826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:05.315826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.315826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:05.315826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.315826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.315826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:05.315826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.315826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:05.316200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.316883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.317518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:05.317518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.317518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:05.317518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:05.318108 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:05.318700 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:05.319103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:05.319868 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.319868 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:05.319868 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.319868 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.319868 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:05.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.319868 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:05.321199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.321634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:05.322887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.323539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:05.324229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.324229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:05.324317 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:05.325018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:05.325579 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:05.326015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:05.326260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.327140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:05.327140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.327140 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:05.327140 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.327140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.327140 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:05.327140 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.327140 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.328786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:05.329428 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:09.863568 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:09.865404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:09.898707 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:09.898707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:09.899354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:09.899354 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:09.899354 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:09.899354 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:09.899354 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:09.899354 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:09.899354 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:09.899354 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:09.900578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:09.901607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:10.295858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:10.297264 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:10.297669 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:10.298045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.299088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:10.299088 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.299088 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:10.299088 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.299088 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.299088 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:10.299088 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.299088 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:10.300307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.302050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:10.310754 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:10.311187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:10.311726 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:10.312033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.312739 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:10.312739 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.312739 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:10.312739 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.312739 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.312739 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:10.312739 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.312739 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:10.313923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:10.314912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:10.314912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.314912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:10.314912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.314912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.314912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:10.314912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.314912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:10.315596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.316394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.317302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:10.317302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.317302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:10.317993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:10.318477 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:10.318945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:10.319157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.319781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:10.319781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.319781 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:10.319781 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.319781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.319781 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:10.319781 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.319781 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:10.321025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.321438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:10.323003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.323682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:10.324345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.324345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:10.324734 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:10.325102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:10.325366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:10.325587 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:10.325758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.326204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:10.326204 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.326204 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:10.326204 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.326204 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.326204 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:10.326204 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.326204 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.327689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:10.328387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:14.864268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:14.865855 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:14.901970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:14.902177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:14.902931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:14.902931 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:14.902931 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:14.902931 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:14.902931 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:14.902931 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:14.902931 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:14.902931 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:14.903808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:14.904650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:15.296360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:15.297675 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:15.297982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:15.298336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.299487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:15.299487 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.299487 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:15.299487 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.299487 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.299487 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:15.299487 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.299487 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:15.300669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.301389 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:15.311285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:15.311865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:15.312316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:15.312536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.313137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:15.313137 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.313137 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:15.313137 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.313137 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.313137 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:15.313137 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.313137 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:15.314446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:15.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:15.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:15.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:15.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:15.316047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.316855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.317641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:15.317641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.317641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:15.318442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:15.318958 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:15.319368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:15.319600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.320409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:15.320409 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.320409 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:15.320409 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.320409 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.320409 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:15.320409 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.320409 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:15.321749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.322508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:15.323475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.324350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:15.325269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.325269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:15.325492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:15.326014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:15.326633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:15.327098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:15.327354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.328049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:15.328049 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.328049 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:15.328049 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.328049 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.328049 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:15.328049 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.328049 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.329060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:15.329574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:19.865283 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:19.867144 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:19.896987 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=257 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:38:19.902455 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:19.902804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:19.903838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:19.903838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:19.903838 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:19.903838 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:19.903838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:19.903838 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:19.903838 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:19.903838 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:19.905070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:19.906055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:20.297126 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:20.298497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:20.298907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:20.299161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.300292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:20.300292 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.300292 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:20.300292 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.300292 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.300292 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:20.300292 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.300292 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:20.302129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.302702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:20.311809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:20.312357 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:20.312973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:20.313278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.314046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:20.314046 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.314046 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:20.314046 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.314046 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.314046 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:20.314046 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.314046 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:20.315311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:20.315903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:20.315903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.315903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:20.315903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.315903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.315903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:20.315903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.315903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:20.316886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.317391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.317987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:20.317987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.317987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:20.318839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:20.319641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:20.320311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:20.320716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.321577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:20.321577 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.321577 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:20.321577 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.321577 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.321577 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:20.321577 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.321577 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:20.322922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.323410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:20.324626 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.325121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:20.325679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.325679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:20.326753 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:20.327311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:20.327793 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:20.328272 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:20.328506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.329346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:20.329346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.329346 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:20.329346 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.329346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.329346 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:20.329346 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.329346 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.331087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:20.331652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:24.866161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:24.867605 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:24.901258 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:24.901638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:24.902321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:24.902321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:24.902321 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:24.902321 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:24.902321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:24.902321 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:24.902321 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:24.902321 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:24.903201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:24.904066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:25.297939 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:25.299428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:25.299760 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:25.300007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.301305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:25.301305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.301305 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:25.301305 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.301305 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.301305 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:25.301305 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.301305 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:25.303059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.303936 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:25.312268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:25.312814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:25.313359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:25.313705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.314383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:25.314383 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.314383 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:25.314383 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.314383 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.314383 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:25.314383 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.314383 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:25.315697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:25.316485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:25.316485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.316485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:25.316485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.316485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.316485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:25.316485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.316485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:25.317212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.318011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.318912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:25.318912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.318912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:25.319327 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:25.320025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:25.320503 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:25.320883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.321594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:25.321594 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.321594 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:25.321594 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.321594 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.321594 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:25.321594 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.321594 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:25.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.323005 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:25.323834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.324285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:25.324831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.324831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:25.327157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:25.327570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:25.328002 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:25.328328 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:25.328537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.329352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:25.329352 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.329352 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:25.329352 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.329352 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.329352 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:25.329352 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.329352 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.331115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:25.331778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:29.866766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:29.867715 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:29.905345 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:29.905654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:29.906315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:29.906315 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:29.906315 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:29.906315 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:29.906315 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:29.906315 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:29.906315 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:29.906315 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:29.907736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:29.908732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:30.298926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:30.300557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:30.300948 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:30.301199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.302236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:30.302236 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.302236 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:30.302236 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.302236 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.302236 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:30.302236 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.302236 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:30.304214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.305415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:30.312738 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:30.313039 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:30.313512 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:30.313837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.314491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:30.314491 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.314491 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:30.314491 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.314491 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.314491 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:30.314491 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.314491 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:30.315828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:30.316425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:30.316425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.316425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:30.316425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.316425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.316425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:30.316425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.316425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:30.317349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.318481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.319743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:30.319743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.319743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:30.319743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:30.320512 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:30.320954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:30.321167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.321895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:30.321895 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.321895 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:30.321895 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.321895 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.321895 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:30.321895 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.321895 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:30.323639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.324157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:30.326154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.326640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:30.327276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.327276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:30.327647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:30.328059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:30.328389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:30.328601 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:30.328749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.329327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:30.329327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.329327 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:30.329327 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.329327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.329327 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:30.329327 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.329327 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.330856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:30.331837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:34.867468 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:34.869386 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:34.905967 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:34.906395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:34.907321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:34.907321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:34.907321 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:34.907321 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:34.907321 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:34.907321 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:34.907321 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:34.907321 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:34.908271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:34.909157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:35.299751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:35.300644 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:35.300935 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:35.301082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.301759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:35.301759 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.301759 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:35.301759 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.301759 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.301759 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:35.301759 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.301759 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:35.302981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.304147 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:35.313369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:35.313705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:35.314164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:35.314450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.315155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:35.315155 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.315155 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:35.315155 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.315155 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.315155 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:35.315155 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.315155 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:35.316355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:35.316967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:35.316967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.316967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:35.316967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.316967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.316967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:35.316967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.316967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:35.317907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.318767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.319778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:35.319778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.319778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:35.320205 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:35.320658 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:35.321221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:35.321681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.322724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:35.322724 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.322724 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:35.322724 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.322724 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.322724 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:35.322724 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.322724 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:35.324394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:35.325175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:35.325830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.326650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:35.328033 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:35.328364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:35.328914 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:35.329374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:35.329593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.330309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:35.330309 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.330309 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:35.330309 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.330309 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.330309 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:35.330309 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.330309 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.331731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:35.332307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:39.868277 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:39.870593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:39.910699 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:39.911326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:39.912085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:39.912085 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:39.912085 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:39.912085 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:39.912085 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:39.912085 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:39.912085 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:39.912085 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:39.913016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:39.914113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:40.300429 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:40.301813 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:40.302114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:40.302343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.303319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:40.303319 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.303319 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:40.303319 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.303319 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.303319 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:40.303319 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.303319 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:40.305366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.306204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:40.313936 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:40.314311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:40.314984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:40.315199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.315883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:40.315883 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.315883 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:40.315883 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.315883 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.315883 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:40.315883 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.315883 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:40.316895 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:40.317853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:40.317853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.317853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:40.317853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.317853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.317853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:40.317853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.317853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:40.318594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.319343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.320288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:40.320288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.320288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:40.320564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:40.320960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:40.321434 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:40.321811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.322517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:40.322517 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.322517 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:40.322517 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.322517 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.322517 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:40.322517 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.322517 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:40.323364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.323860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:40.324459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.325015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:40.325809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.325809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:40.328358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:40.328758 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:40.329200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:40.329530 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:40.329777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.330410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:40.330410 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.330410 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:40.330410 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.330410 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.330410 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:40.330410 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.330410 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.332079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:40.332790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:44.869111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:44.870783 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:44.905608 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:44.905962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:44.906861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:44.906861 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:44.906861 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:44.906861 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:44.906861 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:44.906861 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:44.906861 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:44.906861 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:44.908306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:44.909609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:45.301217 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:45.302540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:45.302804 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:45.303056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.304000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:45.304000 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.304000 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:45.304000 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.304000 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.304000 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:45.304000 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.304000 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:45.305533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.306381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:45.315020 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:45.315020 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:45.315541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:45.315967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.316780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:45.316780 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.316780 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:45.316780 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.316780 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.316780 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:45.316780 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.316780 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:45.318047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:45.318650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:45.318650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.318650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:45.318650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.318650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.318650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:45.318650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.318650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:45.319582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.320201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.320730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:45.320730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.320730 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:45.320989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:45.321628 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:45.322178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:45.322518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.323290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:45.323290 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.323290 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:45.323290 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.323290 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.323290 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:45.323290 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.323290 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:45.324703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.325291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:45.326481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.326967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:45.327466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.327466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:45.328757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:45.329335 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:45.329795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:45.330129 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:45.330344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.331143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:45.331143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.331143 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:45.331143 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.331143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.331143 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:45.331143 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.331143 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.333126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:45.333726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:49.869945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:49.871268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:49.904173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:49.904623 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:49.905703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:49.905703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:49.905703 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:49.905703 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:49.905703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:49.905703 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:49.905703 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:49.905703 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:49.907588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:49.908039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:50.301903 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:50.303237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:50.303485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:50.303703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.304532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:50.304532 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.304532 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:50.304532 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.304532 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.304532 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:50.304532 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.304532 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:50.306403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.306807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:50.316084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:50.316629 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:50.317117 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:50.317327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.318133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:50.318133 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.318133 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:50.318133 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.318133 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.318133 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:50.318133 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.318133 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:50.318499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.319322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:50.320309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.321140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:50.321819 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:50.322242 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:50.322625 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:50.322871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.323390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:38:50.323390 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.323390 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:50.323390 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.323390 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.323390 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:50.323390 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.323390 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:50.324081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.324527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:50.324880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.325282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:50.325768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.325768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:50.329243 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:50.329845 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:50.330581 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:50.331099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:50.331363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.332590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:38:50.332590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.332590 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:50.332590 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.332590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.332590 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:50.332590 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.332590 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:50.334848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:54.870659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:54.872141 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:54.909192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:54.909603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:54.910500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:54.910500 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:54.910500 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:54.910500 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:54.910500 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:54.910500 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:54.910500 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:54.910500 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:54.911705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:54.912263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:55.302677 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:55.304110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:55.304525 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:55.304819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.305841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:38:55.305841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.305841 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:55.305841 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.305841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.305841 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:55.305841 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.305841 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:55.308043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.308690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:55.316861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:55.317226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:38:55.317794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:55.318097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.318918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:38:55.318918 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.318918 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:55.318918 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.318918 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.318918 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:55.318918 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.318918 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:55.320320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:55.321141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:55.321141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.321141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:55.321141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.321141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.321141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:55.321141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.321141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:38:55.321885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.322750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.323707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:55.323707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.323707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:55.365485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:55.365485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:55.366556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:55.366848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:55.367304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:55.367773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.368658 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:55.369154 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:55.369386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.369986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:38:55.369986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.369986 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:55.369986 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.369986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.369986 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:55.369986 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.369986 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:38:55.371462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.372137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:38:55.373683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.374454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:55.375391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:55.376225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:55.377208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:38:59.871366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:38:59.872764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:38:59.909379 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:38:59.909919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:59.910818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:38:59.910818 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:59.910818 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:38:59.910818 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:38:59.910818 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:59.910818 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:38:59.910818 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:59.910818 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:59.911806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:38:59.912714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:00.303286 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:00.304407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:00.304581 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:00.304762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.305350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:00.305350 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.305350 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:00.305350 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.305350 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.305350 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:00.305350 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.305350 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:00.306691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.307239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:00.317268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:00.317750 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:00.318371 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:00.318556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.319183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:00.319183 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.319183 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:00.319183 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.319183 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.319183 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:00.319183 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.319183 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:00.320505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:00.321653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:00.321653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.321653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:00.321653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.321653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.321653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:00.321653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.321653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:00.322216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.323194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.324314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:00.324314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.324314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:00.366018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:00.366760 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:00.367540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:00.367909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:00.368369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.369027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:00.369027 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.369027 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:00.369027 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.369027 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.369027 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:00.369027 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.369027 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:00.370903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:00.371921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:00.374180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.374850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.376385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:00.376986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:04.872291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:04.873718 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:04.919577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:04.919989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:04.920783 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:04.920783 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:04.920783 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:04.920783 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:04.920783 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:04.920783 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:04.920783 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:04.920783 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:04.922137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:04.923217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:05.304361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:05.305213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:05.305526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:05.305765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.306666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:05.306666 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.306666 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:05.306666 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.306666 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.306666 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:05.306666 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.306666 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:05.308219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.308832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:05.317786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:05.318306 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:05.318742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:05.319096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.319565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:05.319565 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.319565 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:05.319565 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.319565 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.319565 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:05.319565 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.319565 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:05.320462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:05.321240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:05.321240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.321240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:05.321240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.321240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.321240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:05.321240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.321240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:05.321664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.322361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.323162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:05.323162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.323162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:05.366812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:05.367450 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:05.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:05.368323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.368991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:05.368991 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.368991 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:05.368991 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.368991 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.368991 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:05.368991 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.368991 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:05.370303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.370640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:05.372509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.372845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:05.373185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.373185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:05.373185 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:05.373260 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:05.373866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:05.374039 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:05.374039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.374549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:05.374549 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.374549 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:05.374549 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.374549 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.374549 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:05.374549 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.374549 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.375695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:05.376563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:09.873012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:09.874641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:09.916160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:09.916648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:09.917738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:09.917738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:09.917738 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:09.917738 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:09.917738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:09.917738 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:09.917738 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:09.917738 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:09.919711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:09.920514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:10.304860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:10.306349 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:10.306668 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:10.306948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.307971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:10.307971 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.307971 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:10.307971 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.307971 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.307971 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:10.307971 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.307971 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:10.309997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.310446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:10.318250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:10.318526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:10.319010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:10.319330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.320047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:10.320047 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.320047 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:10.320047 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.320047 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.320047 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:10.320047 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.320047 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:10.321048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:10.321467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:10.321467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.321467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:10.321467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.321467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.321467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:10.321467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.321467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:10.322577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.323305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.324267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:10.324267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.324267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:10.367477 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:10.368136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:10.368732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:10.369184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.369940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:10.369940 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.369940 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:10.369940 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.369940 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.369940 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:10.369940 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.369940 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:10.371300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.371965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:10.373050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.373786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:10.374569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.374569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:10.374569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:10.374569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:10.374569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:10.374569 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:10.375095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.375326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:10.375326 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.375326 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:10.375326 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.375326 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.375326 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:10.375326 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.375326 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.376484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:10.377069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:14.873808 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:14.875089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:14.917577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:14.917854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:14.918518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:14.918518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:14.918518 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:14.918518 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:14.918518 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:14.918518 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:14.918518 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:14.918518 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:14.919409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:14.920069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:15.305719 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:15.307193 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:15.307512 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:15.307801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.308785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:15.308785 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.308785 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:15.308785 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.308785 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.308785 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:15.308785 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.308785 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:15.310723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.311191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:15.318799 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:15.319506 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:15.320155 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:15.320456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.321336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:15.321336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.321336 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:15.321336 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.321336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.321336 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:15.321336 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.321336 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:15.323181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:15.324126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:15.324126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.324126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:15.324126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.324126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.324126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:15.324126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.324126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:15.324897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.325773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.326655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:15.326655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.326655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:15.368110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:15.368573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:15.369267 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:15.369884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.370528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:15.370528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.370528 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:15.370528 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.370528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.370528 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:15.370528 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.370528 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:15.371969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.372608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:15.373871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.374437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:15.374997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.374997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:15.374997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:15.374997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:15.374997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:15.375241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:15.375520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.376448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:15.376448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.376448 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:15.376448 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.376448 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.376448 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:15.376448 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.376448 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.377448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:15.377981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:19.874480 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:19.876526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:19.904103 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=239 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:39:19.911204 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:19.911552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:19.912516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:19.912516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:19.912516 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:19.912516 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:19.912516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:19.912516 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:19.912516 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:19.912516 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:19.913898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:19.914493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:20.306481 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:20.307876 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:20.308273 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:20.308514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.309576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:20.309576 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.309576 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:20.309576 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.309576 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.309576 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:20.309576 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.309576 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:20.311633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.312605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:20.319407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:20.319836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:20.320250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:20.320475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.321080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:20.321080 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.321080 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:20.321080 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.321080 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.321080 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:20.321080 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.321080 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:20.322553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.324547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:20.325334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.326174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:20.368727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:20.369130 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:20.369731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:20.370074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.370863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:20.370863 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.370863 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:20.370863 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.370863 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.370863 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:20.370863 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.370863 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:20.372134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.372886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:20.373851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.374585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:20.375437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.375437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:20.375437 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:20.375437 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:20.375437 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:20.375777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:20.375878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.376638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:20.376638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.376638 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:20.376638 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.376638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.376638 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:20.376638 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.376638 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.378506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:20.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:24.875465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:24.877511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:24.919592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:24.919987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:24.921380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:24.921380 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:24.921380 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:24.921380 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:24.921380 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:24.921380 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:24.921380 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:24.921380 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:24.922034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:24.923043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:25.307271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:25.308646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:25.309011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:25.309248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.310251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:25.310251 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.310251 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:25.310251 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.310251 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.310251 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:25.310251 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.310251 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:25.311432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.312200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:25.320019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:25.320451 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:25.320980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:25.321280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.322404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:25.322404 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.322404 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:25.322404 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.322404 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.322404 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:25.322404 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.322404 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:25.323659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:25.324493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:25.324493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.324493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:25.324493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.324493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.324493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:25.324493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.324493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:25.325261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.326043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.326885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:25.326885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.326885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:25.369341 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:25.370076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:25.370843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:25.371314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.372207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:25.372207 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.372207 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:25.372207 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.372207 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.372207 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:25.372207 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.372207 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:25.373717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.374747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:25.375339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.376196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:25.377152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.377152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:25.377152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:25.377152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:25.377152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:25.377152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:25.377152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.378103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:25.378103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.378103 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:25.378103 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.378103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.378103 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:25.378103 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.378103 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.379883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:25.381022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:29.876530 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:29.878283 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:29.911710 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:29.911947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:29.912698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:29.912698 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:29.912698 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:29.912698 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:29.912698 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:29.912698 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:29.912698 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:29.912698 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:29.913793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:29.914446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:30.308118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:30.309243 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:30.309645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:30.309933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.310975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:30.310975 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.310975 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:30.310975 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.310975 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.310975 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:30.310975 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.310975 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:30.312570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.313603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:30.320430 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:30.321163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:30.321755 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:30.322030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.322747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:30.322747 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.322747 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:30.322747 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.322747 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.322747 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:30.322747 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.322747 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:30.324088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:30.324605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:30.324605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.324605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:30.324605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.324605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.324605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:30.324605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.324605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:30.325878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.326334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.327015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:30.327015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.327015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:30.369930 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:30.370289 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:30.370747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:30.371196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.371940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:30.371940 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.371940 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:30.371940 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.371940 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.371940 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:30.371940 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.371940 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:30.373172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.373919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:30.374764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.375465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:30.376262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.376262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:30.376262 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:30.377136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:30.377547 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:30.377921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:30.378108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.378860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:30.378860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.378860 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:30.378860 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.378860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.378860 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:30.378860 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.378860 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.380017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:30.380499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:34.877326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:34.878665 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:34.912448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:34.912838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:34.913539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:34.913539 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:34.913539 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:34.913539 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:34.913539 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:34.913539 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:34.913539 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:34.913539 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:34.914366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:34.914869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:35.308764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:35.310034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:35.310349 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:35.310713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.311676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:35.311676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.311676 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:35.311676 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.311676 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.311676 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:35.311676 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.311676 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:35.313873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.314327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:35.320794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:35.321197 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:35.321560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:35.321824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.322391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:35.322391 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.322391 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:35.322391 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.322391 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.322391 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:35.322391 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.322391 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:35.323253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:35.324073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:35.324073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.324073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:35.324073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.324073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.324073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:35.324073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.324073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:35.324475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.325266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.326096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:35.326096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.326096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:35.370499 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:35.371031 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:35.371580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:35.372038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.372915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:35.372915 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.372915 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:35.372915 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.372915 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.372915 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:35.372915 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.372915 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:35.374261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.374968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:35.376163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.376876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:35.377924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.377924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:35.377924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:35.377924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:35.378420 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:35.378731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:35.378893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.379587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:35.379587 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.379587 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:35.379587 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.379587 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.379587 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:35.379587 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.379587 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.381462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:35.382166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:39.877814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:39.879570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:39.915765 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:39.916209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:39.917116 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:39.917116 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:39.917116 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:39.917116 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:39.917116 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:39.917116 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:39.917116 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:39.917116 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:39.918191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:39.919051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:40.309818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:40.310923 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:40.311151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:40.311319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.312168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:40.312168 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.312168 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:40.312168 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.312168 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.312168 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:40.312168 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.312168 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:40.314032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.314546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:40.321251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:40.321965 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:40.322529 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:40.322873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.323779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:40.323779 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.323779 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:40.323779 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.323779 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.323779 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:40.323779 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.323779 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:40.325103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:40.326376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:40.326376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.326376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:40.326376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.326376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.326376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:40.326376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.326376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:40.327419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.328222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.329079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:40.329079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.329079 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:40.371069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:40.371484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:40.372172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:40.372479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.373204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:40.373204 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.373204 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:40.373204 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.373204 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.373204 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:40.373204 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.373204 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:40.374578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.375089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:40.376473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.377421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:40.378417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.378417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:40.378417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:40.378417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:40.378678 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:40.378836 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:40.378991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.379603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:40.379603 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.379603 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:40.379603 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.379603 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.379603 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:40.379603 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.379603 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.381254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:40.382251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:44.878413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:44.879984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:44.920119 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:44.920437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:44.921346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:44.921346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:44.921346 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:44.921346 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:44.921346 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:44.921346 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:44.921346 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:44.921346 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:44.922653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:44.923243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:45.310480 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:45.312152 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:45.312517 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:45.312823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.314106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:45.314106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.314106 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:45.314106 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.314106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.314106 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:45.314106 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.314106 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:45.316068 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.317012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:45.321979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:45.322465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:45.323007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:45.323225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.323773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:45.323773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.323773 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:45.323773 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.323773 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.323773 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:45.323773 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.323773 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:45.324673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:45.325220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:45.325220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.325220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:45.325220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.325220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.325220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:45.325220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.325220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:45.325747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.326305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.327075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:45.327075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.327075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:45.371637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:45.372029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:45.372561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:45.372788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.373377 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:45.373377 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.373377 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:45.373377 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.373377 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.373377 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:45.373377 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.373377 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:45.374252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.374723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:45.375368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.375862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:45.376374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.376374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:45.377887 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:45.378417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:45.378699 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:45.378869 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:45.378982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:45.379436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.379436 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:45.379436 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.379436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.379436 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:45.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.379436 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.380749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:45.381269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:49.879160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:49.881215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:49.920016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:49.920259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:49.921111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:49.921111 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:49.921111 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:49.921111 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:49.921111 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:49.921111 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:49.921111 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:49.921111 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:49.922935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:49.923550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:50.311789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:50.313536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:50.313536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:50.313868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.314685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:50.314685 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.314685 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:50.314685 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.314685 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.314685 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:50.314685 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.314685 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:50.316567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.317601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:50.322555 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:50.323221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:50.323701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:50.324255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.324770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:50.324770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.324770 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:50.324770 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.324770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.324770 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:50.324770 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.324770 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:50.326107 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:50.327086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:50.327086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.327086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:50.327086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.327086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.327086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:50.327086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.327086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:50.327785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.328586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.329191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:50.329191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.329191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:50.372274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:50.372918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:50.373479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:50.373941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.374823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:50.374823 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.374823 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:50.374823 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.374823 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.374823 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:50.374823 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.374823 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:50.376141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.376813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:50.377948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.378681 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:50.379586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.379586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:50.379586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:50.379586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:50.379586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:50.379945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:50.380007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.380818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:50.380818 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.380818 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:50.380818 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.380818 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.380818 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:50.380818 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.380818 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.382214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:50.382812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:54.879753 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:54.881319 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:54.924234 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:54.924723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:54.925647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:54.925647 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:54.925647 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:54.925647 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:54.925647 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:54.925647 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:54.925647 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:54.925647 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:54.926638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:54.927577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:55.312486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:55.314115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:55.314555 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:55.314856 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.315725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:39:55.315725 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.315725 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:55.315725 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.315725 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.315725 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:55.315725 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.315725 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:55.317916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.319104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:55.322987 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:55.323690 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:39:55.324259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:55.324564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.325533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:39:55.325533 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.325533 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:55.325533 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.325533 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.325533 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:55.325533 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.325533 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:55.326415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:55.327191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:55.327191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.327191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:55.327191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.327191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.327191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:55.327191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.327191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:39:55.327561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.328250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.329012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:55.329012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.329012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:55.372963 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:55.373722 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:55.374226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:55.374557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.375323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:39:55.375323 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.375323 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:55.375323 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.375323 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.375323 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:55.375323 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.375323 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:39:55.376245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.377033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:39:55.377434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.377960 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:55.378644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.378644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:55.378753 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:55.379408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:55.379960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:55.380458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:55.380750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.382247 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:39:55.382247 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.382247 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:55.382247 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.382247 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.382247 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:55.382247 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.382247 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.383674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:55.384208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:39:59.880334 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:39:59.882326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:39:59.915961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:39:59.916275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:59.917163 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:39:59.917163 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:59.917163 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:39:59.917163 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:39:59.917163 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:59.917163 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:39:59.917163 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:59.917163 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:59.917857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:39:59.918365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:00.313268 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:00.314892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:00.315228 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:00.315475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.316793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:00.316793 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.316793 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:00.316793 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.316793 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.316793 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:00.316793 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.316793 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:00.318374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.319282 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:00.323519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:00.323957 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:00.324378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:00.324690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.325332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:00.325332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.325332 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:00.325332 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.325332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.325332 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:00.325332 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.325332 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:00.326462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:00.327012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:00.327012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.327012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:00.327012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.327012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.327012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:00.327012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.327012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:00.328023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.328512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.329045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:00.329045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.329045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:00.373647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:00.374486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:00.375161 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:00.375592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.376523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:00.376523 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.376523 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:00.376523 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.376523 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.376523 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:00.376523 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.376523 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:00.377800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.378507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:00.379528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.380346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:00.381124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.381124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:00.381124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:00.381124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:00.381124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:00.381410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:00.381715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.382481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:00.382481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.382481 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:00.382481 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.382481 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.382481 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:00.382481 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.382481 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.384560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:00.385033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:04.880962 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:04.881936 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:04.913495 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:04.914263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:04.914460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:04.914460 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:04.914460 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:04.914460 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:04.914460 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:04.914460 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:04.914460 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:04.914460 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:04.915712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:04.916125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:05.314025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:05.315354 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:05.315601 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:05.315864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.316965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:05.316965 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.316965 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:05.316965 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.316965 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.316965 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:05.316965 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.316965 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:05.318714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.319491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:05.324127 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:05.324597 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:05.325149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:05.325442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.326144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:05.326144 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.326144 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:05.326144 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.326144 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.326144 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:05.326144 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.326144 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:05.326841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:05.327370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:05.327370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.327370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:05.327370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.327370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.327370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:05.327370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.327370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:05.327772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.328322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.328893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:05.328893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.328893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:05.374279 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:05.374624 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:05.375011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:05.375278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.375826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:05.375826 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.375826 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:05.375826 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.375826 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.375826 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:05.375826 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.375826 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:05.376590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.377329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:05.377923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.378750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:05.379637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.379637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:05.380241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:05.380974 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:05.381309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:05.381534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:05.381711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.382323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:05.382323 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.382323 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:05.382323 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.382323 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.382323 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:05.382323 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.382323 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.384351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:05.384848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:09.881450 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:09.883132 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:09.920288 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:09.920797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:09.921894 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:09.921894 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:09.921894 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:09.921894 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:09.921894 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:09.921894 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:09.921894 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:09.921894 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:09.923132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:09.923964 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:10.314942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:10.316366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:10.316740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:10.316986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.318143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:10.318143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.318143 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:10.318143 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.318143 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.318143 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:10.318143 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.318143 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:10.320034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.321018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:10.324686 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:10.325267 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:10.325692 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:10.326090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.327050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:10.327050 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.327050 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:10.327050 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.327050 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.327050 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:10.327050 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.327050 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:10.328012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.328673 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:10.329161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:10.374839 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:10.375416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:10.376584 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:10.376584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.377160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:10.377160 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.377160 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:10.377160 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.377160 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.377160 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:10.377160 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.377160 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:10.378500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.379157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:10.380271 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.380994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:10.381801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.381801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:10.381801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:10.381801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:10.381801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:10.381801 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:10.382091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.382602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:10.382602 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.382602 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:10.382602 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.382602 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.382602 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:10.382602 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.382602 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.383591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:10.384318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:14.882125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:14.884089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:14.920803 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:14.921111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:14.921737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:14.921737 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:14.921737 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:14.921737 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:14.921737 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:14.921737 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:14.921737 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:14.921737 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:14.922538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:14.923341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:15.315530 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:15.316953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:15.317200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:15.317346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.318473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:15.318473 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.318473 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:15.318473 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.318473 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.318473 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:15.318473 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.318473 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:15.320466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.321123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:15.325097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:15.325547 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:15.326044 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:15.326228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.326787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:15.326787 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.326787 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:15.326787 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.326787 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.326787 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:15.326787 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.326787 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:15.328025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:15.328608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:15.328608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.328608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:15.328608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.328608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.328608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:15.328608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.328608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:15.329512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.330144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.330707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:15.330707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.330707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:15.375435 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:15.376299 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:15.376964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:15.377391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.378399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:15.378399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.378399 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:15.378399 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.378399 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.378399 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:15.378399 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.378399 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:15.379759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.380199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:15.381857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.382325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:15.383021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.383021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:15.383021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:15.383021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:15.383439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:15.383740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:15.383914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.384534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:15.384534 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.384534 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:15.384534 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.384534 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.384534 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:15.384534 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.384534 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.386625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:15.387110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:19.882878 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:19.884462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:19.908014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=236 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:40:19.922488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:19.922921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:19.923869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:19.923869 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:19.923869 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:19.923869 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:19.923869 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:19.923869 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:19.923869 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:19.923869 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:19.925015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:19.926258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:20.316263 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:20.317860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:20.318131 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:20.318313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.319257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:20.319257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.319257 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:20.319257 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.319257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.319257 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:20.319257 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.319257 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:20.321132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.321572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:20.325488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:20.325987 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:20.326345 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:20.326541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.327095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:40:20.327095 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.327095 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:20.327095 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.327095 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.327095 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:20.327095 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.327095 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:20.327886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.328329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:20.328842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.329841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:20.329841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.329841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:20.376462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:20.376893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:20.377533 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:20.378010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.378805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:20.378805 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.378805 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:20.378805 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.378805 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.378805 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:20.378805 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.378805 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:20.380098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.380810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:20.381890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.382678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:20.383419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.383419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:20.383419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:20.383419 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:20.383654 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:20.383869 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:20.384279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.384904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:20.384904 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.384904 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:20.384904 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.384904 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.384904 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:20.384904 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.384904 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.385550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:20.386486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:23.319499 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:23.329210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 08 13:40:23.330399 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104932) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 08 13:40:23.330399 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Fixing resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:40:23.364083 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, resource={'id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'name': 'private', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['b9c480ba-80ab-475b-b935-84420037c6ca', 'd4905e6d-9f85-4996-afec-3692c12d93d1'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:10:08Z', 'updated_at': '2026-04-08T13:10:12Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21658}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.364908 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.365060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c9a391e0-7fa7-4719-b96c-81fc2e60a06f, external_ids_update=None, columns={'tag': 21658}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.365753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.366181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:23.366181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.366181 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:23.366181 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.366181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.366181 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:23.366181 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.366181 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Failed to fix resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.367507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.368123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.368720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:40:23.368720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.368720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:40:23.368720 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Fixing resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:40:23.399668 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, resource={'id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'name': 'public', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['88cc7e33-1b68-4e35-9edc-36247de507c0', 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-08T13:10:14Z', 'updated_at': '2026-04-08T13:10:22Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.400029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.400407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-83258353-9720-4502-8be2-b82538bb4ee2, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.400632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.401493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:23.401493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.401493 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:23.401493 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.401493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.401493 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:23.401493 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.401493 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Failed to fix resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.403916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.404533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.405290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:40:23.405290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.405290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:40:23.405290 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Fixing resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:40:23.437173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, resource={'id': 'a5d505fb-12e2-4aed-8078-02b88b929c5e', 'name': 'admin_net', 'tenant_id': '98be377457d344c7834b290dc92d0dda', 'project_id': '98be377457d344c7834b290dc92d0dda', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['39438f35-bd24-4a86-8cab-99f980e8887d'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:05Z', 'updated_at': '2026-04-08T13:14:07Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 13489}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.437592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.438417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-daf5372b-8660-44b8-b300-e46a7451059b, external_ids_update=None, columns={'tag': 13489}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.438708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.439717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:23.439717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.439717 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:23.439717 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.439717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.439717 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:23.439717 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.439717 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Failed to fix resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.440993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.441717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.442325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:40:23.442325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.442325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:40:23.442325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Fixing resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:40:23.467922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-daec8bf3-7182-4be9-bfe4-655236471090, resource={'id': 'daec8bf3-7182-4be9-bfe4-655236471090', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['28da0a33-78ce-48f8-89df-3533da3ec3de'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:49Z', 'updated_at': '2026-04-08T13:14:49Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 54317}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.468233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-daec8bf3-7182-4be9-bfe4-655236471090, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.468675 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-4b03e103-5c09-4760-adf8-c6bbd598718a, external_ids_update=None, columns={'tag': 54317}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.468888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.469601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:23.469601 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.469601 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:23.469601 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.469601 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.469601 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:23.469601 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.469601 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Failed to fix resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.470507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.471089 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.471808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:40:23.471808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.471808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:40:23.471808 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Fixing resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:40:23.540855 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, resource={'id': '71709845-924e-42fd-985e-d000e2c61286', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'enable_snat': True}, 'gw_port_id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-az3g9', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'ip_address': '172.24.5.223', 'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'}, {'ip_address': '2001:db8::19', 'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 3, 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985'}, resource_type=routers, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.541160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.541439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.541631 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.541801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.542525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:23.542525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.542525 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:23.542525 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.542525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.542525 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:23.542525 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.542525 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:23.542792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Unable to update router 71709845-924e-42fd-985e-d000e2c61286. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Failed to fix resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 08 13:40:23.544511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:40:23.544862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:40:23.545222 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Fixing resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:40:23.658441 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, resource={'id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'name': '', 'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'project_id': '', 'mac_address': 'fa:16:3e:d4:5c:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71709845-924e-42fd-985e-d000e2c61286', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164309', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.658872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5 88cc7e33-1b68-4e35-9edc-36247de507c0', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-71709845-924e-42fd-985e-d000e2c61286'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.223/24', '2001:db8::19/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.659100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=59fc94c5-b567-475a-b3a9-f77ef27251c0, lrouter_port=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:23.659370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.660295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:40:23.660295 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.660295 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:23.660295 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.660295 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.660295 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:23.660295 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.660295 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Failed to fix resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.661463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:40:23.662152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:23.662910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:40:23.662910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:23.662910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:40:23.662910 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Maintenance task: Synchronization completed (took 0.33 seconds)
Apr 08 13:40:24.883811 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:24.885522 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:24.919596 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:24.920038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:24.921004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:24.921004 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:24.921004 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:24.921004 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:24.921004 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:24.921004 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:24.921004 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:24.921004 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:24.922204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:24.922787 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:25.317093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:25.318348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:25.318621 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:25.318833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.319586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:40:25.319586 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.319586 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:25.319586 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.319586 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.319586 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:25.319586 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.319586 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:25.321632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.322146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:25.325999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:25.326347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:25.326755 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:25.326996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.327637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:25.327637 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.327637 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:25.327637 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.327637 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.327637 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:25.327637 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.327637 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:25.328668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:25.329382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:25.329382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.329382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:25.329382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.329382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.329382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:25.329382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.329382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:25.330130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.331002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.331475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:25.331475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.331475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:25.377008 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:25.377445 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:25.378252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:25.378754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.379744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:25.379744 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.379744 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:25.379744 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.379744 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.379744 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:25.379744 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.379744 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:25.380910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.381596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:25.382046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.382762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:25.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:25.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:25.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:25.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:25.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:25.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:25.387320 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.387320 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:25.387320 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.387320 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.387320 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:25.387320 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.387320 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.388224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:25.388711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:29.884723 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:29.886681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:29.933990 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:29.934334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:29.935400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:29.935400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:29.935400 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:29.935400 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:29.935400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:29.935400 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:29.935400 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:29.935400 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:29.937016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:29.938529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:30.318003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:30.319410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:30.319641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:30.319779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.320578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:40:30.320578 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.320578 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:30.320578 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.320578 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.320578 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:30.320578 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.320578 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:30.322692 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.323160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:30.326465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:30.327228 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:30.327947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:30.328259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.329069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:30.329069 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.329069 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:30.329069 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.329069 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.329069 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:30.329069 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.329069 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:30.330883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:30.331697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:30.331697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.331697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:30.331697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.331697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.331697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:30.331697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.331697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:30.332362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.333014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.333545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:30.333545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.333545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:30.377961 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:30.378707 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:30.379339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:30.379846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.380740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:30.380740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.380740 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:30.380740 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.380740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.380740 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:30.380740 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.380740 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:30.381430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:30.382429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:30.383143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:30.384001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:30.384563 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:30.384737 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:30.385181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:30.385476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.386229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:30.386229 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.386229 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:30.386229 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.386229 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.386229 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:30.386229 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.386229 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.387039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:30.387910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:34.885597 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:34.887184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:34.920557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:34.920974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:34.921996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:34.921996 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:34.921996 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:34.921996 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:34.921996 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:34.921996 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:34.921996 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:34.921996 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:34.922823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:34.923565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:35.319078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:35.320588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:35.320968 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:35.321210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.322443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:40:35.322443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.322443 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:35.322443 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.322443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.322443 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:35.322443 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.322443 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:35.324269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.325031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:35.327040 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:35.327376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:35.327940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:35.328237 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.328982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:35.328982 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.328982 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:35.328982 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.328982 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.328982 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:35.328982 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.328982 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:35.329760 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:35.330480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:35.330480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.330480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:35.330480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.330480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.330480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:35.330480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.330480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:35.330776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.331182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.331694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:35.331694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.331694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:35.378699 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:35.379265 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:35.379818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:35.380248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.381084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:35.381084 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.381084 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:35.381084 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.381084 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.381084 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:35.381084 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.381084 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:35.382381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.383191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:35.384258 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.385028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:35.385902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.385902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:35.385902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:35.385902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:35.385902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:35.385902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:35.385902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.386363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:35.386363 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.386363 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:35.386363 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.386363 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.386363 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:35.386363 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.386363 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.387182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:35.388178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:39.886384 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:39.888514 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:39.920462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:39.920750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:39.921431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:39.921431 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:39.921431 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:39.921431 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:39.921431 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:39.921431 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:39.921431 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:39.921431 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:39.922404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:39.923712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:40.319906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:40.321227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:40.321521 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:40.321902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.322786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:40:40.322786 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.322786 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:40.322786 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.322786 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.322786 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:40.322786 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.322786 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:40.324465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.325473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:40.327467 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:40.328000 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:40.328535 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:40.328822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.329511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:40.329511 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.329511 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:40.329511 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.329511 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.329511 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:40.329511 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.329511 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:40.330934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:40.331908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:40.331908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.331908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:40.331908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.331908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.331908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:40.331908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.331908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:40.332479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.332979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.333495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:40.333495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.333495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:40.379269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:40.380688 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:40.380688 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:40.380688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.381214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:40.381214 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.381214 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:40.381214 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.381214 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.381214 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:40.381214 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.381214 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:40.382152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.382466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:40.383240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.383580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:40.383939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.383939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:40.384956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:40.385589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:40.386361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:40.386361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:40.386361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.386979 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:40.386979 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.386979 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:40.386979 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.386979 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.386979 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:40.386979 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.386979 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.388839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:40.389679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:44.886982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:44.888109 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:44.922168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:44.922604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:44.923370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:44.923370 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:44.923370 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:44.923370 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:44.923370 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:44.923370 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:44.923370 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:44.923370 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:44.924432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:44.925501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:45.320496 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:45.321850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:45.322183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:45.322425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.323728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:40:45.323728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.323728 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:45.323728 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.323728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.323728 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:45.323728 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.323728 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:45.325800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.326669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:45.327814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:45.328067 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:45.328641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:45.329038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.329835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:45.329835 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.329835 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:45.329835 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.329835 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.329835 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:45.329835 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.329835 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:45.331082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:45.331689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:45.331689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.331689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:45.331689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.331689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.331689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:45.331689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.331689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:45.332916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.333402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.333961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:45.333961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.333961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:45.380118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:45.380743 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:45.381287 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:45.381726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.382557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:45.382557 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.382557 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:45.382557 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.382557 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.382557 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:45.382557 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.382557 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:45.383988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.384723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:45.385100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.385857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:45.386648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.386648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:45.386648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:45.386648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:45.386648 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:45.386954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:45.387061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.388011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:45.388011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.388011 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:45.388011 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.388011 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.388011 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:45.388011 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.388011 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.389859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:45.390728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:49.887806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:49.889456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:49.920737 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:49.921099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:49.922135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:49.922135 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:49.922135 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:49.922135 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:49.922135 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:49.922135 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:49.922135 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:49.922135 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:49.923198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:49.924127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:50.321395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:50.323186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:50.323454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:50.323699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.324550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:40:50.324550 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.324550 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:50.324550 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.324550 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.324550 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:50.324550 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.324550 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:50.326299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.327067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:50.328142 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:50.328552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:50.329063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:50.329292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.330183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:50.330183 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.330183 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:50.330183 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.330183 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.330183 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:50.330183 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.330183 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:50.331121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:50.331880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:50.331880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.331880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:50.331880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.331880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.331880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:50.331880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.331880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:50.332345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.332889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.333408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:50.333408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.333408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:50.380672 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:50.381297 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:50.382049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:50.382526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.383403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:50.383403 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.383403 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:50.383403 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.383403 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.383403 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:50.383403 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.383403 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:50.384810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.385471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:50.386650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.387495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:50.388294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.388294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:50.388294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:50.388294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:50.388294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:50.388294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:50.388666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.389347 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:50.389347 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.389347 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:50.389347 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.389347 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.389347 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:50.389347 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.389347 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:50.391252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:54.888655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:54.890794 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:54.928412 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:54.928898 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:54.929785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:54.929785 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:54.929785 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:54.929785 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:54.929785 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:54.929785 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:54.929785 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:54.929785 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:54.930781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:54.931825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:55.322681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:55.323909 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:55.324078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:55.324254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.325094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:40:55.325094 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.325094 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:55.325094 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.325094 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.325094 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:55.325094 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.325094 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:55.326824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.327598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:55.328840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:55.329091 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:40:55.329459 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:55.329635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.330181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:40:55.330181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.330181 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:55.330181 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.330181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.330181 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:55.330181 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.330181 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:55.331325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:55.332159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:55.332159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.332159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:55.332159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.332159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.332159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:55.332159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.332159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:40:55.332842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.333638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.334175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:55.334175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.334175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:55.381282 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:55.381902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:55.382667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:55.383083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.383943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:40:55.383943 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.383943 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:55.383943 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.383943 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.383943 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:55.383943 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.383943 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:40:55.385322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.386137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:40:55.386995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.387834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:55.388767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.388767 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:55.388767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:55.388767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:55.388767 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:55.389078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:55.389141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.389909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:40:55.389909 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.389909 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:55.389909 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.389909 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.389909 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:55.389909 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.389909 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.391070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:55.391904 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:40:59.889392 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:40:59.891213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:40:59.924774 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:40:59.925190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:59.926244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:40:59.926244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:59.926244 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:40:59.926244 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:40:59.926244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:59.926244 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:40:59.926244 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:59.926244 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:59.927517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:40:59.928288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:00.323315 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:00.324646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:00.324895 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:00.325074 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.325882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:00.325882 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.325882 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:00.325882 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.325882 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.325882 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:00.325882 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.325882 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:00.327835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.328508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:00.329309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:00.329759 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:00.330118 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:00.330312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.330816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:00.330816 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.330816 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:00.330816 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.330816 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.330816 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:00.330816 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.330816 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:00.332119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:00.332808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:00.332808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.332808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:00.332808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.332808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.332808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:00.332808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.332808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:00.333736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.334336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.335076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:00.335076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.335076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:00.381958 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:00.382577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:00.383237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:00.383647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.384503 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:00.384503 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.384503 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:00.384503 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.384503 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.384503 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:00.384503 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.384503 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:00.385987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.386797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:00.388082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.389120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:00.390073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.390073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:00.390073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:00.390073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:00.390073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:00.390073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:00.390387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.391084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:00.391084 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.391084 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:00.391084 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.391084 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.391084 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:00.391084 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.391084 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.392395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:00.393015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:04.890047 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:04.891578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:04.926055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:04.926450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:04.927376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:04.927376 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:04.927376 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:04.927376 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:04.927376 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:04.927376 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:04.927376 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:04.927376 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:04.928596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:04.929541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:05.324223 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:05.325635 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:05.326034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:05.326273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.327316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:05.327316 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.327316 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:05.327316 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.327316 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.327316 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:05.327316 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.327316 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:05.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.330150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:05.330997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:05.330997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:05.330997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:05.330997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.331686 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:05.331686 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.331686 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:05.331686 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.331686 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.331686 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:05.331686 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.331686 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:05.332957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:05.334013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:05.334013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.334013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:05.334013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.334013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.334013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:05.334013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.334013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:05.334529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.335283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.336236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:05.336236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.336236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:05.382485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:05.383139 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:05.383805 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:05.384184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.385057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:05.385057 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.385057 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:05.385057 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.385057 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.385057 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:05.385057 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.385057 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:05.386704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:05.388521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.389654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:05.390519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.390519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:05.390519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:05.390519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:05.390519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:05.390519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:05.390890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.391749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:05.391749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.391749 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:05.391749 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.391749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.391749 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:05.391749 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.391749 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.393517 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:05.394015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:09.890826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:09.892580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:09.925823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:09.926004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:09.926752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:09.926752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:09.926752 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:09.926752 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:09.926752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:09.926752 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:09.926752 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:09.926752 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:09.928034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:09.929154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:10.325305 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:10.326701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:10.327024 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:10.327303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.328324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:10.328324 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.328324 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:10.328324 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.328324 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.328324 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:10.328324 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.328324 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:10.330929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.331887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:10.332666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:10.332666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:10.332666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:10.332831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.333390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:10.333390 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.333390 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:10.333390 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.333390 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.333390 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:10.333390 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.333390 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:10.334268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:10.334707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:10.334707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.334707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:10.334707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.334707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.334707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:10.334707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.334707 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:10.335333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.335778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.336270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:10.336270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.336270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:10.383172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:10.383825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:10.384561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:10.385067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.385985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:10.385985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.385985 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:10.385985 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.385985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.385985 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:10.385985 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.385985 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:10.387336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.388031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:10.389052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.389824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:10.390603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.390603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:10.390603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:10.390603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:10.391000 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:10.391407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:10.391691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.392528 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:10.392528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.392528 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:10.392528 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.392528 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.392528 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:10.392528 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.392528 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.393798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:10.394236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:14.891346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:14.892931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:14.926127 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:14.926527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:14.927410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:14.927410 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:14.927410 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:14.927410 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:14.927410 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:14.927410 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:14.927410 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:14.927410 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:14.928311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:14.929188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:15.325995 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:15.327421 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:15.327784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:15.328024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.329090 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:15.329090 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.329090 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:15.329090 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.329090 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.329090 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:15.329090 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.329090 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:15.331179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.332220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:15.333123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:15.333123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:15.333123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:15.333123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.334056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:15.334056 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.334056 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:15.334056 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.334056 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.334056 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:15.334056 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.334056 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:15.335031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:15.335570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:15.335570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.335570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:15.335570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.335570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.335570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:15.335570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.335570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:15.336284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.337384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:15.337384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.337384 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:15.383805 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:15.384404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:15.385151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:15.385563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.386407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:15.386407 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.386407 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:15.386407 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.386407 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.386407 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:15.386407 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.386407 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:15.387393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.388235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:15.388663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.389364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:15.390159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.390159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:15.390159 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:15.390553 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:15.391069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:15.391711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:15.391711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.392501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:15.392501 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.392501 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:15.392501 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.392501 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.392501 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:15.392501 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.392501 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.394191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:15.395075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:19.891984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:19.893956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:19.914387 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=432 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:41:19.930182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:19.930999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:19.931890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:19.931890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:19.931890 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:19.931890 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:19.931890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:19.931890 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:19.931890 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:19.931890 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:19.933138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:19.933923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:20.326771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:20.328037 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:20.328587 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:20.328869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.329579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:20.329579 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.329579 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:20.329579 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.329579 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.329579 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:20.329579 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.329579 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:20.332560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.333429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.334323 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:20.335246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:20.338253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.338840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:20.384428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:20.385068 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:20.385817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:20.386351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.387326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:20.387326 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.387326 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:20.387326 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.387326 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.387326 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:20.387326 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.387326 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:20.388519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.389226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:20.389908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.390569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:20.391084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.391084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:20.391084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:20.391084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:20.391556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:20.391983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:20.392234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.393131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:20.393131 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.393131 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:20.393131 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.393131 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.393131 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:20.393131 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.393131 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.394747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:20.395256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:24.892552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:24.894181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:24.928701 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:24.928900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:24.929780 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:24.929780 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:24.929780 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:24.929780 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:24.929780 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:24.929780 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:24.929780 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:24.929780 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:24.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:24.931705 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:25.327486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:25.329049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:25.329414 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:25.329726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.330693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:25.330693 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.330693 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:25.330693 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.330693 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.330693 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:25.330693 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.330693 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:25.332632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.333599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.334860 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:25.335478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.336415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:25.337234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.338363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:25.385106 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:25.385855 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:25.386567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:25.387023 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.387905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:25.387905 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.387905 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:25.387905 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.387905 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.387905 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:25.387905 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.387905 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:25.389318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.390063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:25.391168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.391917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:25.392847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.392847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:25.392847 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:25.392847 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:25.392847 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:25.393141 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:25.393201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.394002 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:25.394002 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.394002 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:25.394002 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.394002 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.394002 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:25.394002 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.394002 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.395676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:25.396415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:29.893494 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:29.894977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:29.929566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:29.929980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:29.930990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:29.930990 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:29.930990 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:29.930990 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:29.930990 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:29.930990 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:29.930990 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:29.930990 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:29.931788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:29.932674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:30.328318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:30.329691 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:30.329957 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:30.330145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.331177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:30.331177 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.331177 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:30.331177 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.331177 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.331177 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:30.331177 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.331177 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:30.333731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.335155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.336864 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:30.337852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.339699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:30.340312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.341016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:30.385835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:30.386324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:30.386865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:30.387251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.388061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:30.388061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.388061 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:30.388061 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.388061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.388061 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:30.388061 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.388061 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:30.389400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.390482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:30.391547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.392279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:30.393505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.393505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:30.393505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:30.393505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:30.393505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:30.393505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:30.393505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.393505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:30.394100 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.394100 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:30.394100 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.394100 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.394100 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:30.394100 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.394100 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.394442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:30.395198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:34.894055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:34.895800 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:34.929554 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:34.929554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:34.930186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:34.930186 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:34.930186 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:34.930186 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:34.930186 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:34.930186 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:34.930186 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:34.930186 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:34.931213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:34.931740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:35.328933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:35.330428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:35.330809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:35.331125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.332456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:35.332456 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.332456 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:35.332456 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.332456 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.332456 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:35.332456 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.332456 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:35.334477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.335576 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:35.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:35.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:35.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:35.336879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.337204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:35.337204 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.337204 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:35.337204 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.337204 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.337204 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:35.337204 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.337204 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:35.337881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.339253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:35.339906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.340642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:35.386469 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:35.387396 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:35.387905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:35.388190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.389026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:35.389026 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.389026 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:35.389026 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.389026 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.389026 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:35.389026 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.389026 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:35.390448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.391429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:35.392805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.393408 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:35.393950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.393950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:35.393950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:35.393950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:35.394081 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:35.394482 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:35.394772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.395406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:35.395406 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.395406 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:35.395406 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.395406 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.395406 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:35.395406 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.395406 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.396393 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:35.396967 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:39.895400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:39.896697 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:39.928366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:39.928773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:39.929647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:39.929647 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:39.929647 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:39.929647 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:39.929647 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:39.929647 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:39.929647 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:39.929647 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:39.930648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:39.931823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:40.329557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:40.330716 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:40.330877 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:40.331065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.331738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:40.331738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.331738 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:40.331738 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.331738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.331738 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:40.331738 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.331738 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:40.332822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.333594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:40.335425 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:40.335911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:40.336310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:40.336595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.337449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:40.337449 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.337449 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:40.337449 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.337449 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.337449 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:40.337449 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.337449 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:40.338374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:40.338942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:40.338942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.338942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:40.338942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.338942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.338942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:40.338942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.338942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:40.339491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.339982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.340487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:40.340487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.340487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:40.387255 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:40.387866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:40.388401 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:40.388803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.389645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:40.389645 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.389645 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:40.389645 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.389645 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.389645 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:40.389645 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.389645 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:40.391241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.391977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:40.392909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.393753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:40.394647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.394647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:40.394647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:40.394647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:40.394647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:40.394647 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:40.395061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.395281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:40.395281 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.395281 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:40.395281 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.395281 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.395281 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:40.395281 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.395281 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.396971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:40.397434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:44.895950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:44.897534 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:44.935144 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:44.935326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:44.936115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:44.936115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:44.936115 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:44.936115 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:44.936115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:44.936115 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:44.936115 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:44.936115 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:44.937372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:44.938724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:45.330187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:45.331330 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:45.331560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:45.331728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.332559 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:45.332559 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.332559 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:45.332559 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.332559 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.332559 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:45.332559 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.332559 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:45.334260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.335048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:45.336010 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:45.336139 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:45.336454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:45.336603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.337046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:45.337046 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.337046 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:45.337046 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.337046 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.337046 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:45.337046 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.337046 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:45.337752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.338956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:45.339945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.340991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:45.387892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:45.388324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:45.388823 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:45.389238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.390110 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:45.390110 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.390110 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:45.390110 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.390110 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.390110 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:45.390110 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.390110 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:45.391274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.391991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:45.392997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.393852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:45.394605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.394605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:45.394605 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:45.394605 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:45.394867 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:45.395077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:45.395217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.395814 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:45.395814 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.395814 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:45.395814 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.395814 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.395814 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:45.395814 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.395814 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.397648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:45.398209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:49.896740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:49.897442 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:49.931346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:49.931532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:49.931939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:49.931939 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:49.931939 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:49.931939 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:49.931939 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:49.931939 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:49.931939 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:49.931939 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:49.932689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:49.933719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:50.331057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:50.332085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:50.332285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:50.332446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.333280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:50.333280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.333280 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:50.333280 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.333280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.333280 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:50.333280 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.333280 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:50.335433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.335966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:50.336443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:50.336443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:50.336731 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:50.336918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.337336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:50.337336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.337336 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:50.337336 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.337336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.337336 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:50.337336 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.337336 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:50.338127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:50.338638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:50.338638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.338638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:50.338638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.338638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.338638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:50.338638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.338638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:50.339072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.339513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.340057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:50.340057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.340057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:50.388426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:50.388825 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:50.389270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:50.389634 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.390385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:50.390385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.390385 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:50.390385 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.390385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.390385 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:50.390385 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.390385 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:50.391541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.392321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:50.393227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.394038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:50.395092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.395092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:50.395092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:50.395092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:50.395092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:50.395400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:50.395563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.396352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:50.396352 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.396352 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:50.396352 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.396352 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.396352 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:50.396352 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.396352 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.397420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:50.397916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:54.896979 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:54.897958 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:54.932444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:54.932693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:54.933238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:54.933238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:54.933238 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:54.933238 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:54.933238 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:54.933238 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:54.933238 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:54.933238 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:54.934386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:54.934933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:55.331593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:55.333168 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:55.333498 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:55.333932 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.334822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:41:55.334822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.334822 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:55.334822 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.334822 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.334822 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:55.334822 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.334822 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:55.337042 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.337488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:55.338046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:55.338046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:41:55.338207 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:55.338520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.339252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:41:55.339252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.339252 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:55.339252 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.339252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.339252 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:55.339252 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.339252 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:55.340556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:55.341152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:55.341152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.341152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:55.341152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.341152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.341152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:55.341152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.341152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:41:55.342397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.343330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.344208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:55.344208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.344208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:55.389077 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:55.389896 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:55.390481 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:55.390797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.391509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:41:55.391509 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.391509 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:55.391509 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.391509 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.391509 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:55.391509 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.391509 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:41:55.392988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.393697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:41:55.394838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.395582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:55.396402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.396402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:55.396402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:55.396402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:55.396666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:55.397144 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:55.397460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.398345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:41:55.398345 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.398345 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:55.398345 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.398345 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.398345 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:55.398345 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.398345 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.400061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:55.400906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:41:59.897512 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:41:59.898388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:41:59.927261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:41:59.927641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:59.928495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:41:59.928495 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:59.928495 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:41:59.928495 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:41:59.928495 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:59.928495 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:41:59.928495 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:59.928495 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:59.929578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:41:59.930798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:00.332546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:00.333474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:00.333709 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:00.333870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.334642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:00.334642 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.334642 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:00.334642 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.334642 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.334642 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:00.334642 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.334642 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:00.335727 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.336527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:00.337685 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:00.338057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:00.338515 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:00.338712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.339280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:00.339280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.339280 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:00.339280 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.339280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.339280 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:00.339280 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.339280 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:00.340601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:00.341159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:00.341159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.341159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:00.341159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.341159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.341159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:00.341159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.341159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:00.342554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.343172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.343924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:00.343924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.343924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:00.389749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:00.390254 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:00.391007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:00.391477 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.392436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:00.392436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.392436 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:00.392436 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.392436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.392436 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:00.392436 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.392436 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:00.393418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:00.395262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.395735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:00.396213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.396213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:00.396213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:00.396213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:00.396588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:00.396888 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:00.397080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.397749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:00.397749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.397749 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:00.397749 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.397749 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.397749 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:00.397749 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.397749 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.399429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:04.898018 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:04.898925 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:04.930991 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:04.931322 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:04.932124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:04.932124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:04.932124 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:04.932124 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:04.932124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:04.932124 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:04.932124 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:04.932124 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:04.933230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:04.933975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:05.333258 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:05.334316 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:05.334573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:05.334758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.335450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:05.335450 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.335450 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:05.335450 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.335450 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.335450 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:05.335450 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.335450 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:05.336944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.337421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:05.338226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:05.338301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:05.338655 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:05.338885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.339367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:05.339367 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.339367 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:05.339367 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.339367 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.339367 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:05.339367 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.339367 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:05.340183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:05.340736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:05.340736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.340736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:05.340736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.340736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.340736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:05.340736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.340736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:05.341223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.341688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.342195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:05.342195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.342195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:05.390289 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:05.390792 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:05.391505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:05.391965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.392843 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:05.392843 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.392843 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:05.392843 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.392843 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.392843 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:05.392843 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.392843 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:05.394139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.394437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:05.396041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.396362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:05.396736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.396736 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:05.396736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:05.396736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:05.397258 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:05.397597 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:05.397854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.398540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:05.398540 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.398540 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:05.398540 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.398540 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.398540 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:05.398540 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.398540 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.399506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:05.400080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:09.898550 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:09.899517 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:09.939730 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:09.939919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:09.940631 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:09.940631 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:09.940631 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:09.940631 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:09.940631 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:09.940631 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:09.940631 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:09.940631 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:09.941785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:09.942361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:10.333828 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:10.335180 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:10.335865 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:10.335865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.336638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:10.336638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.336638 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:10.336638 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.336638 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.336638 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:10.336638 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.336638 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:10.337985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.338733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:10.339492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:10.339492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:10.339492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:10.339691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.340091 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:10.340091 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.340091 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:10.340091 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.340091 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.340091 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:10.340091 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.340091 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:10.341319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:10.341799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:10.341799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.341799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:10.341799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.341799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.341799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:10.341799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.341799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:10.343065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.343516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.344145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:10.344145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.344145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:10.390944 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:10.391384 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:10.391936 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:10.392301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.393057 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:10.393057 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.393057 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:10.393057 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.393057 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.393057 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:10.393057 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.393057 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:10.394388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.395095 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:10.396143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.396847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:10.397742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.397742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:10.397742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:10.397742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:10.397742 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:10.398116 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:10.398485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.399085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:10.399085 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.399085 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:10.399085 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.399085 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.399085 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:10.399085 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.399085 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.400713 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:10.401178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:14.899016 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:14.899747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:14.932840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:14.933178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:14.934054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:14.934054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:14.934054 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:14.934054 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:14.934054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:14.934054 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:14.934054 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:14.934054 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:14.935143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:14.936790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:15.334740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:15.336585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:15.336931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:15.337149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.338232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:15.338232 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.338232 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:15.338232 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.338232 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.338232 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:15.338232 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.338232 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:15.339761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.340263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:15.340779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:15.340779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:15.340993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:15.341234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.341989 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:15.341989 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.341989 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:15.341989 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.341989 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.341989 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:15.341989 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.341989 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:15.343196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:15.343812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:15.343812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.343812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:15.343812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.343812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.343812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:15.343812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.343812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:15.344969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.345479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:15.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:15.391766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:15.392470 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:15.393848 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:15.394218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.395407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:15.395407 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.395407 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:15.395407 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.395407 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.395407 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:15.395407 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.395407 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:15.396781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.397111 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:15.399058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.399478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:15.399882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.399882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:15.399882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:15.399882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:15.400536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:15.400802 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:15.400977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.402556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:15.402556 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.402556 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:15.402556 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.402556 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.402556 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:15.402556 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.402556 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:15.405334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:19.899461 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:19.900380 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:19.920646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=241 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:42:19.933951 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:19.934326 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:19.935257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:19.935257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:19.935257 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:19.935257 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:19.935257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:19.935257 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:19.935257 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:19.935257 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:19.936970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:19.937896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:20.335361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:20.336571 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:20.337098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:20.337240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.338276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:20.338276 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.338276 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:20.338276 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.338276 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.338276 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:20.338276 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.338276 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:20.339560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.340367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:20.341124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:20.341124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:20.341124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:20.341470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.342215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:20.342215 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.342215 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:20.342215 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.342215 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.342215 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:20.342215 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.342215 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:20.343435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:20.344356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:20.344356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.344356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:20.344356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.344356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.344356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:20.344356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.344356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:20.345081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.345955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.346486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:20.346486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.346486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:20.392352 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:20.392964 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:20.393456 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:20.393906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.394796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:20.394796 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.394796 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:20.394796 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.394796 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.394796 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:20.394796 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.394796 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:20.396088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.396803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:20.398010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.398857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:20.399822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.399822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:20.399933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:20.400889 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:20.401253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:20.401474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:20.401653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.402357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:20.402357 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.402357 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:20.402357 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.402357 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.402357 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:20.402357 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.402357 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.404391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:20.404890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:24.900023 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:24.901058 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:24.936050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:24.936462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:24.937446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:24.937446 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:24.937446 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:24.937446 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:24.937446 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:24.937446 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:24.937446 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:24.937446 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:24.938458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:24.939401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:25.336012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:25.337190 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:25.337580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:25.338260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.338878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:25.338878 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.338878 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:25.338878 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.338878 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.338878 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:25.338878 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.338878 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:25.340113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.340925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:25.341789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:25.341789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:25.341789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:25.342028 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.342640 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:25.342640 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.342640 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:25.342640 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.342640 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.342640 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:25.342640 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.342640 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:25.343453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:25.344315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:25.344315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.344315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:25.344315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.344315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.344315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:25.344315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.344315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:25.344812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.345684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.346420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:25.346420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.346420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:25.392998 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:25.393692 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:25.394224 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:25.394642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.395422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:25.395422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.395422 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:25.395422 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.395422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.395422 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:25.395422 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.395422 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:25.396641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.397657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:25.398404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.399243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:25.400150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.400150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:25.400463 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:25.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:25.402199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:25.402453 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:25.402571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.403191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:25.403191 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.403191 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:25.403191 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.403191 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.403191 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:25.403191 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.403191 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.404575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:25.405071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:29.900583 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:29.902347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:29.940881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:29.941133 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:29.941795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:29.941795 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:29.941795 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:29.941795 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:29.941795 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:29.941795 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:29.941795 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:29.941795 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:29.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:29.943910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:30.336637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:30.338221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:30.338739 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:30.339065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.341313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:30.341313 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.341313 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:30.341313 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.341313 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.341313 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:30.341313 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.341313 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:30.342141 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:30.344114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.345178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:30.346063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:30.346063 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:30.346063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.346252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:30.346252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.346252 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:30.346252 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.346252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.346252 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:30.346252 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.346252 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:30.347081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:30.347851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:30.347851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.347851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:30.347851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.347851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.347851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:30.347851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.347851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:30.348259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.349764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:30.349764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.349764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:30.393594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:30.394221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:30.394850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:30.395092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.395992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:30.395992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.395992 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:30.395992 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.395992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.395992 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:30.395992 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.395992 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:30.396924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.397607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:30.398041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.398797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:30.399579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.399579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:30.401011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:30.401391 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:30.401798 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:30.402040 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:30.402240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.402924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:30.402924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.402924 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:30.402924 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.402924 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.402924 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:30.402924 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.402924 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.403882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:30.404508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:34.901266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:34.902997 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:34.940483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:34.940822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:34.941316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:34.941316 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:34.941316 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:34.941316 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:34.941316 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:34.941316 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:34.941316 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:34.941316 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:34.942823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:34.943420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:35.337462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:35.338523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:35.339002 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:35.339135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.339802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:35.339802 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.339802 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:35.339802 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.339802 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.339802 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:35.339802 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.339802 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:35.341156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.341887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:35.342652 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:35.343351 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:35.343732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:35.343988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.344454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:35.344454 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.344454 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:35.344454 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.344454 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.344454 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:35.344454 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.344454 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:35.345703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:35.346451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:35.346451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.346451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:35.346451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.346451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.346451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:35.346451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.346451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:35.347259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.347841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.348339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:35.348339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.348339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:35.394381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:35.395029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:35.396104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:35.396788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.397219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:35.397219 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.397219 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:35.397219 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.397219 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.397219 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:35.397219 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.397219 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:35.398825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.399300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:35.401383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.401868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:35.402436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.402436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:35.402436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:35.402436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:35.403101 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:35.403284 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:35.403415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.404182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:35.404182 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.404182 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:35.404182 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.404182 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.404182 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:35.404182 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.404182 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.406246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:35.406983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:39.901956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:39.903151 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:39.940446 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:39.940925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:39.941890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:39.941890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:39.941890 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:39.941890 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:39.941890 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:39.941890 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:39.941890 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:39.941890 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:39.942896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:39.943312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:40.338211 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:40.339263 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:40.339455 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:40.339608 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.340255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:40.340255 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.340255 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:40.340255 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.340255 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.340255 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:40.340255 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.340255 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:40.341436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.342257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:40.343274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:40.343686 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:40.344126 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:40.344372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.344916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:40.344916 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.344916 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:40.344916 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.344916 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.344916 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:40.344916 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.344916 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:40.345630 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:40.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:40.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:40.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:40.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:40.346650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.347146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.347682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:40.347682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.347682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:40.395223 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:40.395772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:40.396553 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:40.396976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.397946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:40.397946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.397946 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:40.397946 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.397946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.397946 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:40.397946 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.397946 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:40.399452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.400063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:40.401399 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.402162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:40.402892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.402892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:40.402892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:40.402892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:40.402892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:40.403142 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:40.403281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.404022 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:40.404022 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.404022 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:40.404022 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.404022 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.404022 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:40.404022 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.404022 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.405132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:40.405784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:44.902661 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:44.904559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:44.943274 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:44.943716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:44.944743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:44.944743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:44.944743 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:44.944743 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:44.944743 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:44.944743 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:44.944743 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:44.944743 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:44.945958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:44.947070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:45.338881 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:45.340182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:45.340936 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:45.341267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.342181 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:45.342181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.342181 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:45.342181 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.342181 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.342181 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:45.342181 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.342181 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:45.343563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.344682 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.345910 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:45.346816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:45.347660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:45.347660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.347660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:45.347660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.347660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.347660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:45.347660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.347660 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:45.348270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.348941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.349669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:45.349669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.349669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:45.395732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:45.396055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:45.396633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:45.396883 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.397437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:45.397437 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.397437 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:45.397437 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.397437 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.397437 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:45.397437 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.397437 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:45.398337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.399098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:45.399541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.400328 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:45.401226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.401226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:45.402425 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:45.403493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:45.404204 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:45.404751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:45.405003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.406165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:45.406165 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.406165 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:45.406165 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.406165 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.406165 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:45.406165 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.406165 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.407738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:45.408219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:49.903339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:49.904812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:49.940566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:49.940874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:49.941493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:49.941493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:49.941493 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:49.941493 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:49.941493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:49.941493 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:49.941493 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:49.941493 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:49.942479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:49.943041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:50.339556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:50.340933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:50.340933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:50.340933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.341438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:50.341438 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.341438 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:50.341438 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.341438 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.341438 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:50.341438 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.341438 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:50.342309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.343013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:50.344561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:50.345132 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:50.345559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:50.345761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.346298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:50.346298 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.346298 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:50.346298 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.346298 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.346298 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:50.346298 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.346298 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:50.347629 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:50.348141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:50.348141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.348141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:50.348141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.348141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.348141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:50.348141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.348141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:50.349381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.349857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.350363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:50.350363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.350363 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:50.396347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:50.396968 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:50.397560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:50.397840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.398478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:50.398478 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.398478 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:50.398478 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.398478 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.398478 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:50.398478 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.398478 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:50.400820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.402017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:50.402520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.403452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:50.404114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.404114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:50.404114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:50.404114 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:50.404392 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:50.404597 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:50.404754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.405402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:50.405402 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.405402 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:50.405402 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.405402 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.405402 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:50.405402 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.405402 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.407663 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:50.408367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:54.904045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:54.905266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:54.939046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:54.939307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:54.940024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:54.940024 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:54.940024 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:54.940024 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:54.940024 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:54.940024 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:54.940024 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:54.940024 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:54.941217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:54.942003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:55.340249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:55.341265 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:55.341417 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:55.341560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.342218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:42:55.342218 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.342218 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:55.342218 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.342218 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.342218 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:55.342218 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.342218 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:55.343376 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.344469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:55.345870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:55.345870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:42:55.345870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:55.346119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.346689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:42:55.346689 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.346689 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:55.346689 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.346689 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.346689 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:55.346689 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.346689 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:55.347498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:55.348495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:55.348495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.348495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:55.348495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.348495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.348495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:55.348495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.348495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:42:55.348963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.349746 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.350572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:55.350572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.350572 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:55.397027 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:55.397873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:55.398592 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:55.399030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.399956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:42:55.399956 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.399956 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:55.399956 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.399956 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.399956 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:55.399956 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.399956 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:42:55.401331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.402134 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:42:55.402633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.403414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:55.404230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.404230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:55.404230 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:55.404586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:55.405042 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:55.405384 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:55.405599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.406423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:42:55.406423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.406423 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:55.406423 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.406423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.406423 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:55.406423 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.406423 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.408390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:55.408977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:42:59.904695 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:42:59.905789 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:42:59.944741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:42:59.945135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:59.946060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:42:59.946060 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:59.946060 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:42:59.946060 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:42:59.946060 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:59.946060 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:42:59.946060 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:59.946060 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:59.947213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:42:59.948366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:00.341138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:00.342940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:00.343310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:00.343577 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.344809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:00.344809 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.344809 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:00.344809 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.344809 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.344809 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:00.344809 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.344809 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:00.346944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.347450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:00.347981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:00.347981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:00.348579 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:00.348947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.350087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:00.350087 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.350087 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:00.350087 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.350087 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.350087 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:00.350087 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.350087 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:00.351425 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.351976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:00.353274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.353772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.354246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:00.354246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.354246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:00.398165 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:00.398902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:00.399460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:00.399882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.400738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:00.400738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.400738 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:00.400738 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.400738 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.400738 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:00.400738 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.400738 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:00.402054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.402719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:00.403421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.404130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:00.404943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.404943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:00.404943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:00.405120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:00.405485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:00.405766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:00.405915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.406541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:00.406541 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.406541 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:00.406541 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.406541 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.406541 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:00.406541 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.406541 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.407963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:00.408672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:04.905159 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:04.907177 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:04.941771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:04.942168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:04.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:04.943126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:04.943126 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:04.943126 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:04.943126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:04.943126 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:04.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:04.943126 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:04.944183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:04.945114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:05.342017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:05.343535 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:05.344025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:05.344392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.345480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:05.345480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.345480 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:05.345480 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.345480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.345480 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:05.345480 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.345480 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.347487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.348353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:05.349585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:05.349585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:05.349585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:05.349585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.350178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:05.350178 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.350178 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:05.350178 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.350178 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.350178 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:05.350178 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.350178 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:05.351792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.352963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:05.353685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.354763 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.356159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:05.356159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.356159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:05.398808 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:05.399413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:05.400196 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:05.400694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.401504 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:05.401504 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.401504 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:05.401504 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.401504 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.401504 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:05.401504 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.401504 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:05.402569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.403190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:05.404064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.404562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:05.405041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.405041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:05.405041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:05.405232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:05.405727 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:05.406112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:05.406354 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.407300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:05.407300 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.407300 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:05.407300 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.407300 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.407300 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:05.407300 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.407300 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.409309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:05.409924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:09.905884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:09.907454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:09.946085 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:09.946495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:09.947534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:09.947534 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:09.947534 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:09.947534 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:09.947534 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:09.947534 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:09.947534 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:09.947534 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:09.948907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:09.949871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:10.343053 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:10.344508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:10.344942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:10.345207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.346255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:10.346255 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.346255 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:10.346255 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.346255 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.346255 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:10.346255 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.346255 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.348465 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.349298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:10.350045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:10.350045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:10.350045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:10.350219 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.351215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:10.351215 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.351215 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:10.351215 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.351215 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.351215 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:10.351215 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.351215 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:10.352397 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:10.352923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:10.352923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.352923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:10.352923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.352923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.352923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:10.352923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.352923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:10.353877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.354337 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.354857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:10.354857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.354857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:10.400536 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:10.401227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:10.402015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:10.402512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.403514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:10.403514 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.403514 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:10.403514 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.403514 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.403514 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:10.403514 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.403514 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:10.404978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.405743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:10.406299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.407127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:10.408124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.408124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:10.408124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:10.408124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:10.408124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:10.408124 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:10.408124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.408821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:10.408821 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.408821 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:10.408821 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.408821 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.408821 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:10.408821 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.408821 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.409861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:10.410374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:14.906490 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:14.908184 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:14.946233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:14.946655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:14.947573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:14.947573 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:14.947573 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:14.947573 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:14.947573 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:14.947573 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:14.947573 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:14.947573 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:14.948501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:14.949594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:15.343971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:15.345436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:15.346003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:15.346262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.347098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:15.347098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.347098 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:15.347098 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.347098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.347098 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:15.347098 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.347098 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.348473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.349410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:15.350557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:15.350557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:15.350557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:15.350557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.351032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:15.351032 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.351032 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:15.351032 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.351032 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.351032 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:15.351032 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.351032 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:15.351996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.352899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:15.353482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.354565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.355526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:15.355526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.355526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:15.401922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:15.402552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:15.403154 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:15.403535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.404499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:15.404499 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.404499 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:15.404499 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.404499 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.404499 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:15.404499 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.404499 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:15.406276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.407026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:15.408441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.409331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:15.410340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.410340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:15.410340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:15.410340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:15.410340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:15.410340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:15.410340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.411103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:15.411103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.411103 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:15.411103 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.411103 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.411103 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:15.411103 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.411103 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.411972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:15.412807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:19.907167 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:19.909148 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:19.930256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=238 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:43:19.945939 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:19.946469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:19.947632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:19.947632 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:19.947632 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:19.947632 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:19.947632 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:19.947632 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:19.947632 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:19.947632 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:19.948899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:19.949863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:20.344945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:20.345925 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:20.346339 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:20.346591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.347333 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:20.347333 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.347333 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:20.347333 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.347333 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.347333 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:20.347333 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.347333 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.349161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.350017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:20.350875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:20.350875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:20.350875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:20.351073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.351717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:20.351717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.351717 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:20.351717 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.351717 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.351717 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:20.351717 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.351717 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:20.353125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.354234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:20.354776 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.355215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.355733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:20.355733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.355733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:20.403108 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:20.403787 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:20.404394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:20.404811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.405596 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:20.405596 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.405596 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:20.405596 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.405596 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.405596 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:20.405596 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.405596 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:20.407003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.407803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:20.409000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.409860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:20.410788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.410788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:20.410788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:20.410788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:20.410788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:20.410788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:20.411148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.411796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:20.411796 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.411796 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:20.411796 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.411796 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.411796 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:20.411796 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.411796 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.413169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:20.413701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:24.907973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:24.909674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:24.948831 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:24.949186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:24.950013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:24.950013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:24.950013 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:24.950013 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:24.950013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:24.950013 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:24.950013 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:24.950013 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:24.952196 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:24.953401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:25.345487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:25.346761 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:25.346992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:25.347153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.347920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:25.347920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.347920 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:25.347920 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.347920 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.347920 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:25.347920 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.347920 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.349791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.350356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:25.350926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:25.350926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:25.351119 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:25.351386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.351983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:25.351983 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.351983 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:25.351983 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.351983 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.351983 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:25.351983 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.351983 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:25.353012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.353565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:25.354171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.354693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.355209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:25.355209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.355209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:25.403827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:25.404355 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:25.404721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:25.404937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.405350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:25.405350 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.405350 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:25.405350 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.405350 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.405350 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:25.405350 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.405350 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:25.407130 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.407917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:25.408385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.409191 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:25.410112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.410112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:25.410112 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:25.410633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:25.411047 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:25.411231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:25.411335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.411886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:25.411886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.411886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:25.411886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.411886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.411886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:25.411886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.411886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.413923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:25.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:29.908765 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:29.910448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:29.942327 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:29.942672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:29.943544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:29.943544 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:29.943544 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:29.943544 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:29.943544 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:29.943544 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:29.943544 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:29.943544 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:29.944315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:29.945356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:30.346375 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:30.347632 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:30.348060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:30.348349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.349214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:30.349214 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.349214 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:30.349214 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.349214 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.349214 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:30.349214 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.349214 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.351230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.352185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:30.352975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:30.352975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:30.352975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:30.353210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.353886 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:30.353886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.353886 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:30.353886 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.353886 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.353886 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:30.353886 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.353886 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:30.355312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.356381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:30.357146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.357973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.358516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:30.358516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.358516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:30.404657 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:30.405172 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:30.405628 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:30.406041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.407000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:30.407000 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.407000 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:30.407000 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.407000 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.407000 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:30.407000 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.407000 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:30.407832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.408525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:30.408986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.409757 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:30.410552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.410552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:30.410552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:30.410906 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:30.411257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:30.411476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:30.411625 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.412126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:30.412126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.412126 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:30.412126 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.412126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.412126 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:30.412126 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.412126 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.413260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:30.414104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:34.909501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:34.911501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:34.948409 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:34.948848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:34.949699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:34.949699 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:34.949699 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:34.949699 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:34.949699 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:34.949699 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:34.949699 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:34.949699 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:34.950573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:34.951059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:35.346992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:35.348427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:35.348675 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:35.349158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.349985 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:35.349985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.349985 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:35.349985 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.349985 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.349985 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:35.349985 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.349985 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.351051 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.351824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:35.352538 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:35.352538 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:35.353076 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:35.353378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.353913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:35.353913 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.353913 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:35.353913 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.353913 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.353913 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:35.353913 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.353913 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:35.354653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.355292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:35.355676 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.356122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.356685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:35.356685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.356685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:35.405426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:35.406001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:35.406599 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:35.407045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.407933 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:35.407933 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.407933 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:35.407933 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.407933 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.407933 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:35.407933 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.407933 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:35.409296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.409982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:35.411230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.411955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:35.412779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.412779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:35.412779 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:35.413041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:35.413871 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:35.414395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:35.414546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.415486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:35.415486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.415486 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:35.415486 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.415486 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.415486 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:35.415486 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.415486 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.417509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:35.418008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:39.910277 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:39.912080 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:39.945895 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:39.946307 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:39.947231 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:39.947231 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:39.947231 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:39.947231 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:39.947231 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:39.947231 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:39.947231 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:39.947231 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:39.948357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:39.949019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:40.347747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:40.349494 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:40.349946 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:40.350204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.352124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:40.352124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.352124 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:40.352124 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.352124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.352124 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:40.352124 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.352124 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.353711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.354658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:40.355541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:40.355541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:40.355541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:40.355541 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.356020 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:40.356020 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.356020 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:40.356020 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.356020 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.356020 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:40.356020 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.356020 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:40.356772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:40.357712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:40.357712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.357712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:40.357712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.357712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.357712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:40.357712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.357712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:40.358187 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.359064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.359982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:40.359982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.359982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:40.406303 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:40.407005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:40.407570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:40.408007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.408847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:40.408847 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.408847 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:40.408847 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.408847 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.408847 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:40.408847 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.408847 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:40.410236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.411018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:40.411980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.412857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:40.413770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.413770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:40.413770 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:40.413770 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:40.413770 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:40.414139 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:40.414308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.415239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:40.415239 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.415239 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:40.415239 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.415239 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.415239 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:40.415239 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.415239 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.416867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:40.417657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:44.911091 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:44.912962 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:44.948474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:44.948901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:44.949923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:44.949923 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:44.949923 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:44.949923 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:44.949923 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:44.949923 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:44.949923 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:44.949923 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:44.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:44.951714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:45.348513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:45.350042 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:45.350416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:45.350774 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.351991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:45.351991 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.351991 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:45.351991 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.351991 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.351991 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:45.351991 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.351991 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:45.353863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.354719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:45.355565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:45.355565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:45.356081 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:45.356402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.357248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:45.357248 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.357248 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:45.357248 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.357248 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.357248 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:45.357248 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.357248 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:45.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:45.359305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:45.359305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.359305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:45.359305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.359305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.359305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:45.359305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.359305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:45.360765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.361275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.361788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:45.361788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.361788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:45.406932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:45.407429 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:45.408350 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:45.408852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.409913 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:45.409913 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.409913 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:45.409913 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.409913 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.409913 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:45.409913 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.409913 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:45.411351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.412086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:45.413432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.414236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:45.415137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.415137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:45.415137 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:45.415137 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:45.415137 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:45.415544 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:45.415838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.416650 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:45.416650 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.416650 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:45.416650 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.416650 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.416650 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:45.416650 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.416650 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.418470 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:45.419242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:49.911854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:49.913304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:49.947772 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:49.948200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:49.949099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:49.949099 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:49.949099 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:49.949099 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:49.949099 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:49.949099 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:49.949099 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:49.949099 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:49.950318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:49.951266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:50.349389 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:50.350300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:50.350575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:50.350865 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.351852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:50.351852 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.351852 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:50.351852 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.351852 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.351852 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:50.351852 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.351852 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:50.353469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.354284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:50.355139 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:50.355861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:50.356393 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:50.356603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.357266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:50.357266 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.357266 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:50.357266 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.357266 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.357266 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:50.357266 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.357266 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:50.359100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:50.359657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:50.359657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.359657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:50.359657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.359657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.359657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:50.359657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.359657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:50.360566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.361075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.361604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:50.361604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.361604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:50.407546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:50.408328 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:50.409004 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:50.409438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.410379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:50.410379 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.410379 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:50.410379 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.410379 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.410379 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:50.410379 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.410379 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:50.412249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.413007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:50.413819 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.414527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:50.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:50.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:50.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:50.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:50.415736 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:50.415966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.416821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:50.416821 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.416821 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:50.416821 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.416821 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.416821 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:50.416821 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.416821 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.418447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:50.418992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:54.912578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:54.914318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:54.952427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:54.952669 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:54.953480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:54.953480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:54.953480 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:54.953480 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:54.953480 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:54.953480 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:54.953480 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:54.953480 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:54.954593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:54.956076 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:55.350023 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:55.351013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:55.351259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:55.351526 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.352394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:43:55.352394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.352394 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:55.352394 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.352394 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.352394 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:55.352394 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.352394 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:55.354272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.355043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:55.355885 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:55.355885 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:43:55.356306 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:55.356480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.356954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:43:55.356954 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.356954 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:55.356954 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.356954 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.356954 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:55.356954 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.356954 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:55.358115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:55.359078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:55.359078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.359078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:55.359078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.359078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.359078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:55.359078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.359078 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:43:55.359414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.359947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.360512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:55.360512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.360512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:55.408245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:55.408735 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:55.409250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:55.409598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.410385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:43:55.410385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.410385 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:55.410385 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.410385 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.410385 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:55.410385 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.410385 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:43:55.411591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.412355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:43:55.413279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.413804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:55.414344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.414344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:55.414746 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:55.415358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:55.415637 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:55.415987 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:55.416132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.416593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:43:55.416593 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.416593 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:55.416593 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.416593 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.416593 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:55.416593 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.416593 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.417536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:55.418201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:43:59.913214 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:43:59.914281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:43:59.943841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:43:59.944203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:59.944896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:43:59.944896 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:59.944896 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:43:59.944896 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:43:59.944896 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:59.944896 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:43:59.944896 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:59.944896 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:59.945689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:43:59.947150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:00.350799 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:00.351985 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:00.352245 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:00.352500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.353298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:00.353298 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.353298 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:00.353298 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.353298 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.353298 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:00.353298 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.353298 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:00.354903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.356045 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:00.357201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:00.357201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:00.357201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:00.357201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.357770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:00.357770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.357770 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:00.357770 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.357770 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.357770 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:00.357770 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.357770 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:00.359049 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:00.359845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:00.359845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.359845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:00.359845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.359845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.359845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:00.359845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.359845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:00.360444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.360977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.361482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:00.361482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.361482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:00.408875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:00.409162 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:00.409737 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:00.410097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.411048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:00.411048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.411048 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:00.411048 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.411048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.411048 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:00.411048 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.411048 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:00.411907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.412413 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:00.412844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.413266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:00.413762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.413762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:00.415314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:00.415710 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:00.415955 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:00.416174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:00.416317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.416808 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:00.416808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.416808 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:00.416808 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.416808 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.416808 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:00.416808 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.416808 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.417831 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:00.418275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:04.913851 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:04.915576 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:04.953129 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:04.954012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:04.954678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:04.954678 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:04.954678 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:04.954678 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:04.954678 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:04.954678 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:04.954678 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:04.954678 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:04.955590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:04.956524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:05.351676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:05.352603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:05.352817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:05.353007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.353992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:05.353992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.353992 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:05.353992 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.353992 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.353992 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:05.353992 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.353992 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:05.355841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.356715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:05.357567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:05.357567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:05.357567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:05.357567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.357842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:05.357842 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.357842 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:05.357842 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.357842 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.357842 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:05.357842 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.357842 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:05.359216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:05.359931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:05.359931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.359931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:05.359931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.359931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.359931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:05.359931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.359931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:05.360394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.360867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.361379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:05.361379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.361379 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:05.409324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:05.409931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:05.410480 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:05.410986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.412031 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:05.412031 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.412031 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:05.412031 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.412031 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.412031 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:05.412031 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.412031 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:05.413753 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.414549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:05.415593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.416647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:05.417557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.417557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:05.417557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:05.417557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:05.417557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:05.417557 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:05.417953 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.418758 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:05.418758 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.418758 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:05.418758 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.418758 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.418758 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:05.418758 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.418758 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.420452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:05.421008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:09.914382 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:09.916247 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:09.954680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:09.955161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:09.956255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:09.956255 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:09.956255 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:09.956255 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:09.956255 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:09.956255 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:09.956255 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:09.956255 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:09.957277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:09.958117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:10.352863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:10.354813 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:10.355259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:10.355609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.356926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:10.357483 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:10.357483 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.357483 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:10.357483 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.357483 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.357483 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:10.357483 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.357483 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:10.358796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.359441 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:10.360381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:10.360381 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:10.360381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.361188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:10.361188 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.361188 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:10.361188 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.361188 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.361188 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:10.361188 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.361188 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:10.362178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.363331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:10.364212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.364813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:10.410069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:10.410531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:10.411188 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:10.411749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.412587 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:10.412587 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.412587 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:10.412587 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.412587 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.412587 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:10.412587 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.412587 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:10.413604 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.414329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:10.414779 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.415556 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:10.416420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.416420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:10.416420 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:10.417028 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:10.417759 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:10.417943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:10.418013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.418853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:10.418853 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.418853 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:10.418853 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.418853 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.418853 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:10.418853 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.418853 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.421172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:10.421709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:14.915179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:14.916989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:14.949283 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:14.949521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:14.950330 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:14.950330 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:14.950330 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:14.950330 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:14.950330 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:14.950330 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:14.950330 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:14.950330 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:14.951435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:14.952866 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:15.353889 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:15.355064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:15.355325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:15.355764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.356508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:15.356508 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.356508 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:15.356508 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.356508 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.356508 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:15.356508 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.356508 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:15.358462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.359424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:15.360233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:15.360233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:15.360356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:15.360523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.361024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:15.361024 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.361024 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:15.361024 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.361024 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.361024 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:15.361024 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.361024 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:15.362314 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:15.363164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:15.363164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.363164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:15.363164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.363164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.363164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:15.363164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.363164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:15.363855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.364560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.365396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:15.365396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.365396 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:15.410741 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:15.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:15.412143 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:15.413185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.413810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:15.413810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.413810 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:15.413810 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.413810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.413810 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:15.413810 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.413810 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:15.415726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.416485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:15.417406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.418195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:15.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:15.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:15.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:15.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:15.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:15.420200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.420471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:15.420471 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.420471 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:15.420471 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.420471 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.420471 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:15.420471 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.420471 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.421632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:15.422173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:19.915670 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:19.917398 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:19.938696 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=239 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:44:19.956664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:19.956999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:19.957838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:19.957838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:19.957838 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:19.957838 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:19.957838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:19.957838 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:19.957838 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:19.957838 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:19.958668 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:19.959194 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:20.354673 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:20.356041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:20.356362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:20.356594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.357601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:20.357601 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.357601 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:20.357601 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.357601 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.357601 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:20.357601 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.357601 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:20.359555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.360427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.361464 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:20.362654 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:20.363555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:20.363555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.363555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:20.363555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.363555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.363555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:20.363555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.363555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:20.364214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.365011 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.365931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:20.365931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.365931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:20.411422 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:20.412029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:20.412586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:20.412691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.413256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:20.413256 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.413256 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:20.413256 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.413256 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.413256 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:20.413256 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.413256 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:20.413942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.414593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:20.414974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.415412 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:20.415922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.415922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:20.418508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:20.419264 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:20.420019 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:20.420267 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:20.420411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.421062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:20.421062 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.421062 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:20.421062 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.421062 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.421062 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:20.421062 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.421062 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.422203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:20.422695 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:24.916766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:24.918421 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:24.961926 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:24.962225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:24.962509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:24.962509 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:24.962509 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:24.962509 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:24.962509 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:24.962509 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:24.962509 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:24.962509 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:24.963291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:24.963908 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:25.355313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:25.357066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:25.357400 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:25.357631 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.358426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:25.358426 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.358426 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:25.358426 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.358426 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.358426 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:25.358426 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.358426 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:25.360453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.361000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:25.361749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:25.361749 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:25.362042 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:25.362350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.363192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:25.363192 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.363192 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:25.363192 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.363192 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.363192 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:25.363192 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.363192 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:25.364540 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.365059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:25.366491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.367168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.367925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:25.367925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.367925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:25.412105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:25.412588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:25.413321 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:25.413833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.414870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:25.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:25.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:25.414870 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.414870 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:25.416403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.416909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:25.417595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.418169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:25.418845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.418845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:25.418966 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:25.419369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:25.420144 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:25.420717 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:25.420970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.421946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:25.421946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.421946 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:25.421946 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.421946 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.421946 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:25.421946 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.421946 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.423594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:25.424506 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:29.917348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:29.919706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:29.953231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:29.953514 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:29.954177 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:29.954177 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:29.954177 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:29.954177 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:29.954177 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:29.954177 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:29.954177 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:29.954177 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:29.955052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:29.955585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:30.356025 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:30.357100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:30.357424 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:30.357693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.358555 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:30.358555 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.358555 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:30.358555 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.358555 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.358555 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:30.358555 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.358555 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.359778 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.360530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:30.361332 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:30.361884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:30.362364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:30.362671 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.363381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:30.363381 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.363381 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:30.363381 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.363381 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.363381 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:30.363381 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.363381 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:30.364321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.365145 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:30.365602 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.366400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.367275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:30.367275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.367275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:30.412683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:30.413327 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:30.413941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:30.414435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.415332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:30.415332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.415332 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:30.415332 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.415332 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.415332 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:30.415332 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.415332 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:30.416838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.417585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:30.418637 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.419460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:30.420336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.420336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:30.420336 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:30.420336 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:30.420600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:30.420985 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:30.421197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.422052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:30.422052 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.422052 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:30.422052 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.422052 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.422052 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:30.422052 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.422052 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.423925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:30.424750 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:34.918945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:34.920541 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:34.953690 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:34.953983 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:34.954759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:34.954759 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:34.954759 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:34.954759 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:34.954759 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:34.954759 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:34.954759 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:34.954759 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:34.955884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:34.956867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:35.356768 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:35.357920 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:35.358069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:35.358234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.358793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:35.358793 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.358793 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:35.358793 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.358793 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.358793 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:35.358793 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.358793 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.359810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.360857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:35.362014 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:35.362399 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:35.362814 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:35.362995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.363570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:35.363570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.363570 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:35.363570 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.363570 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.363570 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:35.363570 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.363570 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:35.364896 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.365754 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:35.366439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.367229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.368125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:35.368125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.368125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:35.413253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:35.413797 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:35.414425 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:35.414852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.415709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:35.415709 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.415709 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:35.415709 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.415709 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.415709 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:35.415709 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.415709 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:35.417195 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.418032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:35.419198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.419988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:35.420796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.420796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:35.420796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:35.420796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:35.421270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:35.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:35.421775 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.422961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:35.422961 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.422961 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:35.422961 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.422961 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.422961 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:35.422961 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.422961 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.425369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:35.425935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:39.919664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:39.921413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:39.959101 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:39.959501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:39.960374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:39.960374 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:39.960374 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:39.960374 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:39.960374 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:39.960374 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:39.960374 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:39.960374 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:39.961466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:39.962351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:40.357552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:40.359142 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:40.359439 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:40.359731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.361067 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:40.361067 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.361067 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:40.361067 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.361067 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.361067 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:40.361067 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.361067 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.362846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.363917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:40.364840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:40.364840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:40.364840 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:40.364840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.365093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:40.365093 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.365093 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:40.365093 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.365093 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.365093 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:40.365093 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.365093 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:40.366193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:40.366722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:40.366722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.366722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:40.366722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.366722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.366722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:40.366722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.366722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:40.367892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.368362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.368881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:40.368881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.368881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:40.413855 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:40.414304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:40.414694 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:40.415001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.415543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:40.415543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.415543 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:40.415543 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.415543 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.415543 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:40.415543 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.415543 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:40.416371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.416844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:40.417454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.417948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:40.418469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.418469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:40.420259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:40.421003 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:40.421413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:40.421638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:40.421869 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.422493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:40.422493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.422493 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:40.422493 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.422493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.422493 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:40.422493 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.422493 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.424206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:40.425118 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:44.920581 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:44.922183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:44.958660 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:44.959103 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:44.959978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:44.959978 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:44.959978 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:44.959978 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:44.959978 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:44.959978 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:44.959978 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:44.959978 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:44.961153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:44.961923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:45.358325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:45.359665 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:45.360034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:45.360270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.361366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:45.361366 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.361366 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:45.361366 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.361366 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.361366 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:45.361366 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.361366 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:45.363450 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.364208 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:45.365071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:45.365071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:45.365071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:45.365071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.365854 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:44:45.365854 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.365854 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:45.365854 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.365854 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.365854 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:45.365854 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.365854 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:45.367285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:45.368041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:45.368041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.368041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:45.368041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.368041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.368041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:45.368041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.368041 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:45.369018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.369641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.370167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:45.370167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.370167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:45.414520 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:45.415173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:45.415872 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:45.416290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.417193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:45.417193 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.417193 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:45.417193 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.417193 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.417193 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:45.417193 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.417193 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:45.418554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.419400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:45.420218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.420818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:45.421374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.421374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:45.421374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:45.421630 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:45.422145 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:45.422511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:45.422861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.423769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:45.423769 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.423769 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:45.423769 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.423769 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.423769 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:45.423769 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.423769 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.425522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:45.426009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:49.921295 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:49.922136 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:49.955022 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:49.955416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:49.956243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:49.956243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:49.956243 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:49.956243 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:49.956243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:49.956243 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:49.956243 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:49.956243 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:49.957014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:49.957885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:50.359079 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:50.360638 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:50.360989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:50.361224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.362261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:50.362261 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.362261 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:50.362261 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.362261 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.362261 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:50.362261 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.362261 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:50.364217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.365069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:50.365943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:50.365943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:50.365943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:50.366131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.366740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:50.366740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.366740 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:50.366740 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.366740 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.366740 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:50.366740 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.366740 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:50.367538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.368003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:50.368726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.369190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.369729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:50.369729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.369729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:50.415206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:50.415918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:50.416529 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:50.417018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.418052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:50.418052 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.418052 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:50.418052 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.418052 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.418052 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:50.418052 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.418052 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:50.419478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.420310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:50.421698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.422140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:50.422821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.422821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:50.422821 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:50.422821 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:50.423338 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:50.423732 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:50.423986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.424646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:50.424646 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.424646 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:50.424646 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.424646 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.424646 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:50.424646 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.424646 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.425911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:50.426436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:54.921781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:54.923486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:54.956244 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:54.956715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:54.958375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:54.958375 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:54.958375 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:54.958375 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:54.958375 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:54.958375 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:54.958375 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:54.958375 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:54.960038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:54.960585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:55.359928 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:55.361314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:55.361704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:55.361963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.363009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:55.363009 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.363009 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:55.363009 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.363009 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.363009 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:55.363009 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.363009 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:55.364875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.365429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:55.366059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:55.366059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:44:55.366394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:55.366751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.367529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:44:55.367529 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.367529 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:55.367529 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.367529 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.367529 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:55.367529 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.367529 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:55.368943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.369479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:44:55.370466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.371039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.371557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:55.371557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.371557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:55.415791 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:55.416454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:55.417318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:55.417892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.418880 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:44:55.418880 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.418880 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:55.418880 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.418880 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.418880 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:55.418880 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.418880 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:44:55.420651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.421607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:44:55.422902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.423420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:55.423981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.423981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:55.423981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:55.424094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:55.424471 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:55.424846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:55.425072 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.425835 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:44:55.425835 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.425835 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:55.425835 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.425835 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.425835 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:55.425835 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.425835 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.427542 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:55.428046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:44:59.922483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:44:59.924257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:44:59.952318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:44:59.952755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:59.953565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:44:59.953565 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:59.953565 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:44:59.953565 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:44:59.953565 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:59.953565 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:44:59.953565 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:59.953565 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:59.954452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:44:59.955348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:00.360652 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:00.362174 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:00.362539 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:00.362806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.363732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:00.363732 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.363732 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:00.363732 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.363732 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.363732 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:00.363732 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.363732 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:00.365355 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.366186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:00.367088 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:00.367088 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:00.367088 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:00.367088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.367566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:00.367566 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.367566 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:00.367566 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.367566 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.367566 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:00.367566 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.367566 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:00.368534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:00.369380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:00.369380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.369380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:00.369380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.369380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.369380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:00.369380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.369380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:00.369801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.370573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.371423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:00.371423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.371423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:00.416390 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:00.416960 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:00.417465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:00.417844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.418728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:00.418728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.418728 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:00.418728 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.418728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.418728 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:00.418728 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.418728 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:00.419958 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:00.421653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.422698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:00.423849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.423849 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:00.423849 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:00.424259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:00.425431 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:00.425730 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:00.425844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:00.426873 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.426873 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:00.426873 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.426873 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.426873 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:00.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.428387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:00.429188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:04.923269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:04.924953 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:04.959721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:04.960012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:04.960855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:04.960855 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:04.960855 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:04.960855 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:04.960855 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:04.960855 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:04.960855 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:04.960855 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:04.961844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:04.962417 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:05.361454 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:05.362977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:05.363323 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:05.363564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.364644 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:05.364644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.364644 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:05.364644 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.364644 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.364644 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:05.364644 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.364644 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:05.366449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.367590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:05.368853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:05.368853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:05.368853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:05.368853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.369129 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:05.369129 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.369129 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:05.369129 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.369129 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.369129 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:05.369129 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.369129 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:05.370345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:05.371398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:05.371398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.371398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:05.371398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.371398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.371398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:05.371398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.371398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:05.371944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.372702 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.373609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:05.373609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.373609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:05.417326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:05.417951 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:05.418861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:05.419375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.420370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:05.420370 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.420370 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:05.420370 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.420370 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.420370 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:05.420370 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.420370 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:05.421519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.422375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:05.422974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.423888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:05.425012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.425012 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:05.425012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:05.425012 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:05.425343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:05.425556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:05.425729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.426253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:05.426253 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.426253 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:05.426253 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.426253 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.426253 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:05.426253 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.426253 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.427353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:05.428228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:09.924055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:09.925723 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:09.964982 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:09.965456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:09.966336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:09.966336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:09.966336 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:09.966336 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:09.966336 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:09.966336 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:09.966336 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:09.966336 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:09.967424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:09.968405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:10.362216 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:10.363486 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:10.363882 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:10.364284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.365220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:10.365220 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.365220 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:10.365220 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.365220 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.365220 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:10.365220 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.365220 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:10.367032 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.368435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.369443 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:10.370467 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:10.371306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:10.371306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.371306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:10.371306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.371306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.371306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:10.371306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.371306 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:10.371993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.372761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.373579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:10.373579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.373579 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:10.417929 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:10.419110 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:10.419793 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:10.420180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.421100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:10.421100 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.421100 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:10.421100 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.421100 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.421100 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:10.421100 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.421100 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:10.422546 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.423317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:10.424460 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.425215 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:10.426029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.426029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:10.426029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:10.426029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:10.426029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:10.426029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:10.426029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.426925 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:10.426925 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.426925 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:10.426925 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.426925 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.426925 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:10.426925 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.426925 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.429014 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:10.429511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:14.924811 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:14.927120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:14.964185 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:14.964523 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:14.965373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:14.965373 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:14.965373 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:14.965373 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:14.965373 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:14.965373 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:14.965373 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:14.965373 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:14.966489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:14.967547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:15.362884 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:15.364251 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:15.364607 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:15.364973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.366146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:15.366146 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.366146 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:15.366146 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.366146 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.366146 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:15.366146 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.366146 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:15.367536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.368058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:15.368565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:15.369232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:15.369757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:15.370046 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.370815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:15.370815 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.370815 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:15.370815 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.370815 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.370815 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:15.370815 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.370815 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:15.372168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:15.372744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:15.372744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.372744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:15.372744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.372744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.372744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:15.372744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.372744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:15.373367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.373862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.374352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:15.374352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.374352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:15.419029 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:15.419640 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:15.420175 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:15.420583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.421427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:15.421427 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.421427 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:15.421427 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.421427 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.421427 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:15.421427 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.421427 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:15.422725 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.423451 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:15.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.425266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:15.426146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.426146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:15.426146 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:15.426146 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:15.426474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:15.426809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:15.426907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.427585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:15.427585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.427585 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:15.427585 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.427585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.427585 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:15.427585 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.427585 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.429213 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:15.429724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:19.925560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:19.927207 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:19.944579 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=238 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:45:19.963856 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:19.964256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:19.965173 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:19.965173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:19.965173 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:19.965173 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:19.965173 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:19.965173 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:19.965173 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:19.965173 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:19.966386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:19.967373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:20.363556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:20.364693 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:20.364980 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:20.365212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.366097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:20.366097 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.366097 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:20.366097 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.366097 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.366097 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:20.366097 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.366097 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:20.367766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.368580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:20.369821 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:20.369821 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:20.370195 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:20.370484 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.371249 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:20.371249 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.371249 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:20.371249 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.371249 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.371249 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:20.371249 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.371249 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:20.372421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:20.373267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:20.373267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.373267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:20.373267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.373267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.373267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:20.373267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.373267 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:20.374001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.374769 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.375597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:20.375597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.375597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:20.419529 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:20.420233 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:20.420838 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:20.421186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.421996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:20.421996 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.421996 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:20.421996 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.421996 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.421996 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:20.421996 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.421996 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:20.423349 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.424010 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:20.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.425888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:20.426607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.426607 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:20.426607 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:20.426607 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:20.427073 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:20.427413 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:20.427633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.428536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:20.428536 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.428536 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:20.428536 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.428536 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.428536 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:20.428536 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.428536 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.430296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:20.431050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:23.320070 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:23.329231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 08 13:45:23.329449 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104932) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 08 13:45:23.329531 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Fixing resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:45:23.361715 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, resource={'id': '74c4c8eb-ebdb-4dc6-b746-23c495d5d99c', 'name': 'private', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['b9c480ba-80ab-475b-b935-84420037c6ca', 'd4905e6d-9f85-4996-afec-3692c12d93d1'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:10:08Z', 'updated_at': '2026-04-08T13:10:12Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21658}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.361975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-74c4c8eb-ebdb-4dc6-b746-23c495d5d99c, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.362211 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c9a391e0-7fa7-4719-b96c-81fc2e60a06f, external_ids_update=None, columns={'tag': 21658}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.362341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.362900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:23.362900 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.362900 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:23.362900 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.362900 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.362900 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:23.362900 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.362900 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Failed to fix resource 74c4c8eb-ebdb-4dc6-b746-23c495d5d99c (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.364040 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.364853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.365581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:45:23.365581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.365581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:45:23.365581 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Fixing resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:45:23.392266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, resource={'id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'name': 'public', 'tenant_id': 'd5b27cdb139d422c942590b827578c69', 'project_id': 'd5b27cdb139d422c942590b827578c69', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['88cc7e33-1b68-4e35-9edc-36247de507c0', 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-08T13:10:14Z', 'updated_at': '2026-04-08T13:10:22Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.392444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.392866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-83258353-9720-4502-8be2-b82538bb4ee2, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.393061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.393566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:23.393566 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.393566 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:23.393566 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.393566 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.393566 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:23.393566 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.393566 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Failed to fix resource 62000aa6-2895-4dcf-a64a-1cd87a10af3e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.394744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.395380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.398303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:45:23.398303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.398303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:45:23.398303 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Fixing resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:45:23.422687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, resource={'id': 'a5d505fb-12e2-4aed-8078-02b88b929c5e', 'name': 'admin_net', 'tenant_id': '98be377457d344c7834b290dc92d0dda', 'project_id': '98be377457d344c7834b290dc92d0dda', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['39438f35-bd24-4a86-8cab-99f980e8887d'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:05Z', 'updated_at': '2026-04-08T13:14:07Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 13489}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.422874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a5d505fb-12e2-4aed-8078-02b88b929c5e, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.423192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-daf5372b-8660-44b8-b300-e46a7451059b, external_ids_update=None, columns={'tag': 13489}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.423303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.423841 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:23.423841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.423841 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:23.423841 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.423841 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.423841 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:23.423841 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.423841 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Failed to fix resource a5d505fb-12e2-4aed-8078-02b88b929c5e (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.424999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.425410 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.425914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:45:23.425914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.425914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:45:23.425914 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Fixing resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:45:23.453818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-daec8bf3-7182-4be9-bfe4-655236471090, resource={'id': 'daec8bf3-7182-4be9-bfe4-655236471090', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['28da0a33-78ce-48f8-89df-3533da3ec3de'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-08T13:14:49Z', 'updated_at': '2026-04-08T13:14:49Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 54317}, resource_type=networks, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.454108 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-daec8bf3-7182-4be9-bfe4-655236471090, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.454471 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-4b03e103-5c09-4760-adf8-c6bbd598718a, external_ids_update=None, columns={'tag': 54317}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.454603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.455350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:23.455350 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.455350 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:23.455350 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.455350 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.455350 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:23.455350 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.455350 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Failed to fix resource daec8bf3-7182-4be9-bfe4-655236471090 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.457009 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.457772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.458691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:45:23.458691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.458691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:45:23.458691 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Fixing resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:45:23.533205 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, resource={'id': '71709845-924e-42fd-985e-d000e2c61286', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'project_id': 'b3e9dff62ee84fb1b22908381f57c985', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'enable_snat': True}, 'gw_port_id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-az3g9', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'external_fixed_ips': [{'ip_address': '172.24.5.223', 'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5'}, {'ip_address': '2001:db8::19', 'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 3, 'tenant_id': 'b3e9dff62ee84fb1b22908381f57c985'}, resource_type=routers, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.533488 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-71709845-924e-42fd-985e-d000e2c61286, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-az3g9', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.533590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.533737 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "59fc94c5-b567-475a-b3a9-f77ef27251c0"')], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.533899 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.534567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:23.534567 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.534567 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:23.534567 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.534567 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.534567 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:23.534567 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.534567 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:23.535236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Unable to update router 71709845-924e-42fd-985e-d000e2c61286. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Failed to fix resource 71709845-924e-42fd-985e-d000e2c61286 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 08 13:45:23.536369 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:45:23.536821 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:45:23.537261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Fixing resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports) at create/update {{(pid=104932) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 08 13:45:23.639781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, resource={'id': '59fc94c5-b567-475a-b3a9-f77ef27251c0', 'name': '', 'network_id': '62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'project_id': '', 'mac_address': 'fa:16:3e:d4:5c:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71709845-924e-42fd-985e-d000e2c61286', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5', 'ip_address': '172.24.5.223'}, {'subnet_id': '88cc7e33-1b68-4e35-9edc-36247de507c0', 'ip_address': '2001:db8::19'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164309', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-08T13:14:50Z', 'updated_at': '2026-04-08T13:14:52Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.640219 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'bcaf3e07-0ddb-4d79-a902-5b250dafa0e5 88cc7e33-1b68-4e35-9edc-36247de507c0', 'neutron:network_name': 'neutron-62000aa6-2895-4dcf-a64a-1cd87a10af3e', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-71709845-924e-42fd-985e-d000e2c61286'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.223/24', '2001:db8::19/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.640766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=59fc94c5-b567-475a-b3a9-f77ef27251c0, lrouter_port=lrp-59fc94c5-b567-475a-b3a9-f77ef27251c0, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:23.641131 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.642123 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:45:23.642123 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.642123 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:23.642123 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.642123 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.642123 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:23.642123 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.642123 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Failed to fix resource 59fc94c5-b567-475a-b3a9-f77ef27251c0 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.643437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 08 13:45:23.644027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:23.644642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 08 13:45:23.644642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:23.644642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 08 13:45:23.644642 np0000164309 neutron-ovn-maintenance-worker[104932]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Maintenance task: Synchronization completed (took 0.31 seconds)
Apr 08 13:45:24.926253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:24.927888 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:24.965270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:24.965704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:24.966569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:24.966569 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:24.966569 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:24.966569 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:24.966569 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:24.966569 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:24.966569 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:24.966569 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:24.967749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:24.968813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:25.364235 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:25.365470 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:25.365842 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:25.366139 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.367719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:25.367719 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.367719 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:25.367719 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.367719 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.367719 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:25.367719 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.367719 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.369486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.370238 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:25.371041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:25.371041 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:25.371193 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:25.371446 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.372054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:25.372054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.372054 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:25.372054 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.372054 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.372054 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:25.372054 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.372054 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:25.372807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.373670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:25.374142 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.375006 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.375812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:25.375812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.375812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:25.420078 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:25.420733 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:25.421229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:25.421708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.422468 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:25.422468 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.422468 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:25.422468 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.422468 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.422468 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:25.422468 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.422468 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:25.423788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.424420 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:25.425418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.426193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:25.426994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.426994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:25.426994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:25.426994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:25.427226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:25.427642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:25.427951 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.428645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:25.428645 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.428645 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:25.428645 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.428645 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.428645 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:25.428645 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.428645 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.429807 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:25.430387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:29.926983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:29.928689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:29.977876 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:29.978211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:29.978938 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:29.978938 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:29.978938 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:29.978938 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:29.978938 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:29.978938 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:29.978938 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:29.978938 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:29.979827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:29.980265 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:30.364941 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:30.366225 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:30.366564 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:30.366900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.367818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:30.367818 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.367818 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:30.367818 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.367818 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.367818 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:30.367818 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.367818 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.369500 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.370510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:30.371601 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:30.371601 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:30.371601 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:30.371948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.372631 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:30.372631 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.372631 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:30.372631 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.372631 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.372631 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:30.372631 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.372631 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:30.373962 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.375151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:30.375909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.377141 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.377937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:30.377937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.377937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:30.420841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:30.421378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:30.421834 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:30.422169 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.423003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:30.423003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.423003 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:30.423003 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.423003 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.423003 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:30.423003 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.423003 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:30.424262 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:30.425988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.427101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:30.428015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.428015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:30.428015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:30.428015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:30.428015 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:30.428418 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:30.428418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.429226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:30.429226 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.429226 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:30.429226 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.429226 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.429226 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:30.429226 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.429226 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.430993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:30.431646 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:34.927764 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:34.929181 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:34.988145 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:34.988335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:34.988972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:34.988972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:34.988972 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:34.988972 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:34.988972 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:34.988972 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:34.988972 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:34.988972 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:34.989929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:34.990321 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:35.365597 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:35.366861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:35.367060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:35.367198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.367874 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:35.367874 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.367874 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:35.367874 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.367874 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.367874 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:35.367874 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.367874 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.369667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.370926 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:35.372050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:35.372050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:35.372050 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:35.372445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.373317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:35.373317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.373317 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:35.373317 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.373317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.373317 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:35.373317 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.373317 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:35.374720 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.375401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:35.375846 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.376449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.376963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:35.376963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.376963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:35.421458 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:35.422093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:35.422889 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:35.423292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.424165 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:35.424165 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.424165 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:35.424165 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.424165 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.424165 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:35.424165 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.424165 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:35.425454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.426225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:35.427225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.427977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:35.428810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.428810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:35.428810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:35.428810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:35.428810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:35.429095 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:35.429246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.430217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:35.430217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.430217 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:35.430217 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.430217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.430217 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:35.430217 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.430217 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.432694 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:35.433160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:39.928465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:39.930125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:39.972545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:39.972934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:39.973824 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:39.973824 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:39.973824 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:39.973824 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:39.973824 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:39.973824 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:39.973824 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:39.973824 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:39.974737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:39.975284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:40.366560 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:40.368218 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:40.368509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:40.368689 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.369439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:40.369439 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.369439 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:40.369439 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.369439 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.369439 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:40.369439 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.369439 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.371252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.371810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:40.372347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:40.372347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:40.372434 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:40.372631 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.373120 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:40.373120 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.373120 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:40.373120 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.373120 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.373120 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:40.373120 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.373120 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:40.373922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.374414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:40.374978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.375461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.375972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:40.375972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.375972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:40.422366 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:40.422942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:40.423870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:40.424257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.426600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.427155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:40.427566 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.428021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:40.428474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.428474 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:40.428474 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:40.428575 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:40.428947 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:40.429186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:40.429342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.429914 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:40.429914 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.429914 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:40.429914 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.429914 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.429914 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:40.429914 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.429914 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.431802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:40.432295 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:44.929252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:44.930918 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:44.968876 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:44.969315 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:44.970248 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:44.970248 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:44.970248 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:44.970248 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:44.970248 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:44.970248 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:44.970248 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:44.970248 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:44.971234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:44.972205 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:45.367786 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:45.369005 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:45.369332 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:45.369575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.370452 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:45.370452 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.370452 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:45.370452 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.370452 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.370452 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:45.370452 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.370452 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.372454 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.373805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.375590 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:45.376478 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:45.377716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:45.378444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.379359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:45.423013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:45.423546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:45.424359 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:45.424920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.425838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:45.425838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.425838 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:45.425838 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.425838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.425838 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:45.425838 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.425838 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:45.427201 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.427991 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:45.428922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.429853 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:45.430812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.430812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:45.430812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:45.430812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:45.430812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:45.431156 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:45.431285 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.432244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:45.432244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.432244 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:45.432244 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.432244 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.432244 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:45.432244 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.432244 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.433986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:45.434799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:49.930106 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:49.931927 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:49.965255 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:49.965723 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:49.966868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:49.966868 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:49.966868 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:49.966868 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:49.966868 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:49.966868 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:49.966868 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:49.966868 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:49.968798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:49.969160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:50.368487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:50.369680 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:50.370036 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:50.370259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.371066 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:50.371066 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.371066 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:50.371066 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.371066 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.371066 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:50.371066 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.371066 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.372246 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.373508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:50.374485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:50.374485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:50.374485 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:50.374485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.374954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:50.374954 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.374954 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:50.374954 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.374954 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.374954 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:50.374954 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.374954 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:50.376297 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.377092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:50.378015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.378666 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.379220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:50.379220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.379220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:50.423831 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:50.424615 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:50.425342 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:50.425810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.426833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:50.426833 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.426833 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:50.426833 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.426833 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.426833 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:50.426833 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.426833 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:50.428062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.428986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:50.429674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.431364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:50.432509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.432509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:50.432509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:50.432509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:50.432509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:50.432509 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:50.432509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.432509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:45:50.433146 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.433146 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:50.433146 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.433146 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.433146 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:50.433146 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.433146 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.433747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:50.434438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:54.930733 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:54.932350 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:54.971984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:54.972309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:54.973254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:54.973254 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:54.973254 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:54.973254 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:54.973254 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:54.973254 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:54.973254 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:54.973254 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:54.974735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:54.975715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:55.369102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:55.370817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:55.370817 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:55.371184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.372115 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:45:55.372115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.372115 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:55.372115 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.372115 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.372115 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:55.372115 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.372115 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.373709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.374581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:55.375667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:55.375667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:45:55.375667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:55.375916 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.376605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:45:55.376605 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.376605 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:55.376605 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.376605 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.376605 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:55.376605 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.376605 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:55.378168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.379461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:45:55.379995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.380833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.381818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:55.381818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.381818 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:55.424994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:55.425358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:55.426065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:55.426688 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:55.428479 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.428479 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:55.428479 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.428479 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.428479 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:55.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.428479 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:45:55.430073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.430959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:45:55.432220 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.433221 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:55.434252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.434252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:55.434252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:55.434252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:55.434252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:55.434252 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:55.434252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.434696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:45:55.434696 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.434696 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:55.434696 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.434696 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.434696 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:55.434696 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.434696 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.435940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:55.436881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:45:59.931493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:45:59.932847 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:45:59.970676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:45:59.971235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:59.972217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:45:59.972217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:59.972217 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:45:59.972217 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:45:59.972217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:59.972217 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:45:59.972217 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:59.972217 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:59.973180 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:45:59.974059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:00.369721 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:00.370841 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:00.371187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:00.371442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.372429 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:46:00.372429 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.372429 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:00.372429 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.372429 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.372429 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:00.372429 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.372429 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.374055 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.374717 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:00.375194 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:00.375241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:00.375826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:00.376152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.377080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:46:00.377080 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.377080 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:00.377080 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.377080 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.377080 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:00.377080 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.377080 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:00.378582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.379101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:00.380567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.381050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.381565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:00.381565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.381565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:00.425679 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:00.426407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:00.427060 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:00.427432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.428235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:00.428235 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.428235 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:00.428235 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.428235 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.428235 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:00.428235 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.428235 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:00.429600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.430086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:00.431401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.432112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:00.432855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.432855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:00.432952 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:00.433584 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:00.434066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:00.434267 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:00.434422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.435098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:00.435098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.435098 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:00.435098 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.435098 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.435098 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:00.435098 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.435098 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.436855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:00.437580 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:04.932066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:04.933376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:04.969892 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:04.970146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:04.971206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:04.971206 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:04.971206 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:04.971206 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:04.971206 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:04.971206 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:04.971206 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:04.971206 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:04.972155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:04.973372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:05.370471 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:05.371983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:05.372322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:05.372584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.373482 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:46:05.373482 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.373482 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:05.373482 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.373482 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.373482 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:05.373482 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.373482 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.375226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.376106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:05.376858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:05.376858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:05.377346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:05.377693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.378677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:46:05.378677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.378677 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:05.378677 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.378677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.378677 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:05.378677 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.378677 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:05.379635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.380590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:05.381108 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.381957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.383086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:05.383086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.383086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:05.426935 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:05.427440 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:05.428276 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:05.428893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.429816 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:05.429816 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.429816 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:05.429816 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.429816 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.429816 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:05.429816 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.429816 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:05.431400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.432342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:05.433062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.433536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:05.434266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.434266 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:05.434266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:05.434266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:05.434266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:05.434266 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:05.434593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.435113 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:05.435113 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.435113 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:05.435113 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.435113 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.435113 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:05.435113 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.435113 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.436287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:05.436871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:09.933121 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:09.935200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:09.978578 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:09.978997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:09.979907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:09.979907 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:09.979907 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:09.979907 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:09.979907 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:09.979907 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:09.979907 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:09.979907 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:09.980820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:09.981603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:10.371111 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:10.372471 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:10.372858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:10.373122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.374021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:46:10.374021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.374021 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:10.374021 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.374021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.374021 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:10.374021 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.374021 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.375850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.376731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:10.377606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:10.377606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:10.378035 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:10.378335 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.379298 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:46:10.379298 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.379298 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:10.379298 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.379298 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.379298 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:10.379298 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.379298 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:10.381633 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.382105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:10.383039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.383549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.384184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:10.384184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.384184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:10.427384 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:10.427907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:10.428473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:10.428939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.429811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:10.429811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.429811 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:10.429811 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.429811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.429811 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:10.429811 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.429811 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:10.431416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.432144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:10.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.434343 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:10.435310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.435310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:10.435310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:10.435310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:10.435310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:10.435588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:10.435832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.436527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:10.436527 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.436527 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:10.436527 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.436527 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.436527 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:10.436527 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.436527 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.438303 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:10.439121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:14.933835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:14.935062 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:14.969843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:14.970150 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:14.970994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:14.970994 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:14.970994 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:14.970994 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:14.970994 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:14.970994 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:14.970994 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:14.970994 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:14.972199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:14.973186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:15.371859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:15.373186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:15.373464 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:15.373748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.374527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:46:15.374527 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.374527 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:15.374527 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.374527 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.374527 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:15.374527 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.374527 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.376146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.376955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:15.377730 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:15.377924 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:15.378505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:15.378861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.379449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:46:15.379449 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.379449 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:15.379449 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.379449 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.379449 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:15.379449 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.379449 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:15.380409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.380935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:15.381448 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.381945 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.382476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:15.382476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.382476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:15.428098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:15.428810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:15.429441 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:15.429813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.430595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:15.430595 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.430595 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:15.430595 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.430595 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.430595 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:15.430595 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.430595 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:15.431884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.432748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:15.433515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.434334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:15.435239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.435239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:15.435239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:15.435239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:15.435239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:15.435711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:15.436069 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.436999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:15.436999 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.436999 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:15.436999 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.436999 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.436999 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:15.436999 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.436999 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.438016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:15.438839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:19.934540 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:19.936109 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:19.952356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=432 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:46:19.977826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:19.978038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:19.978472 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:19.978472 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:19.978472 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:19.978472 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:19.978472 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:19.978472 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:19.978472 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:19.978472 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:19.979462 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:19.980313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:20.372542 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:20.373932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:20.374395 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:20.374790 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.376233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:46:20.376233 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.376233 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:20.376233 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.376233 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.376233 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:20.376233 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.376233 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.377993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.378301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:20.378650 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:20.378957 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:20.379320 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:20.379622 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.380405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:46:20.380405 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.380405 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:20.380405 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.380405 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.380405 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:20.380405 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.380405 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:20.380987 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:20.381674 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:20.382320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.383070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:20.428912 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:20.429529 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:20.430158 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:20.430665 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.431444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:20.431444 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.431444 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:20.431444 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.431444 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.431444 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:20.431444 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.431444 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:20.432712 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.433434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:20.434463 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.435197 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:20.436038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.436038 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:20.436038 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:20.436038 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:20.436038 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:20.436476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:20.436817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.437553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:20.437553 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.437553 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:20.437553 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.437553 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.437553 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:20.437553 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.437553 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.439279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:20.440203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:24.935243 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:24.937079 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:24.976916 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:24.977241 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:24.978167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:24.978167 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:24.978167 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:24.978167 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:24.978167 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:24.978167 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:24.978167 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:24.978167 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:24.979635 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:24.980545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:25.373301 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:25.375038 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:25.375360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:25.375662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.376487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 08 13:46:25.376487 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.376487 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:25.376487 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.376487 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.376487 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:25.376487 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.376487 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.378411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.379268 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:25.380094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:25.380094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:25.380094 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:25.380323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.380941 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:46:25.380941 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.380941 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:25.380941 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.380941 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.380941 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:25.380941 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.380941 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:25.381649 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.382157 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:25.382419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.382878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.383378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:25.383378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.383378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:25.429954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:25.430436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:25.431061 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:25.431524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.432609 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:25.432609 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.432609 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:25.432609 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.432609 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.432609 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:25.432609 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.432609 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:25.433591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.434292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:25.434715 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.435405 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:25.436232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.436232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:25.436232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:25.436232 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:25.436452 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:25.436649 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:25.436801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.437390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:25.437390 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.437390 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:25.437390 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.437390 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.437390 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:25.437390 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.437390 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.439367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:25.439875 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:29.936437 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:29.938138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:29.974057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:29.974515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:29.975443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:29.975443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:29.975443 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:29.975443 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:29.975443 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:29.975443 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:29.975443 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:29.975443 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:29.976332 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:29.977358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:30.393497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:30.393497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:30.395209 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:30.395209 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:30.395697 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:30.395888 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.396950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:30.396950 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.396950 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:30.396950 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.396950 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.396950 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:30.396950 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.396950 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:30.399073 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.399606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:30.400198 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:30.400198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.400762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:30.400762 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.400762 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:30.400762 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.400762 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.400762 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:30.400762 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.400762 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:30.402185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.402830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:30.403480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.404030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.404643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:30.404643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.404643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:30.430878 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:30.431066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:30.432057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:30.432710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.433535 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:46:30.433535 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.433535 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:30.433535 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.433535 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.433535 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:30.433535 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.433535 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:30.434861 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.435638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:30.436956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.437734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:30.438513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.438513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:30.438513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:30.438513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:30.438513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:30.438513 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:30.438882 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.439372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:46:30.439372 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.439372 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:30.439372 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.439372 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.439372 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:30.439372 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.439372 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.440411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:30.441122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:34.937264 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:34.939167 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:34.973013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:34.973185 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:34.973631 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:34.973631 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:34.973631 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:34.973631 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:34.973631 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:34.973631 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:34.973631 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:34.973631 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:34.974481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:34.975242 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:35.393948 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:35.394846 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:35.395561 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:35.431023 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:35.432983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:35.432983 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:35.434182 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:35.434182 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.435277 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:35.435277 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.435277 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:35.435277 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.435277 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.435277 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:35.435277 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.435277 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:35.437345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.438299 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:35.439250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:35.439250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:35.439250 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.439438 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:35.439438 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.439438 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:35.439438 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.439438 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.439438 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:35.439438 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.439438 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:35.441367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.441845 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:35.442150 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:35.442221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:35.444159 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.444652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.445214 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:35.446302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:35.446917 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:35.448025 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.448554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.449071 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.450515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:35.451027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:39.937940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:39.939938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:39.978056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:39.978327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:39.979024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:39.979024 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:39.979024 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:39.979024 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:39.979024 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:39.979024 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:39.979024 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:39.979024 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:39.979909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:39.980848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:40.394551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:40.395516 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:40.396095 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:40.397556 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:40.398207 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:40.398502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.399942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:40.399942 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.399942 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:40.399942 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.399942 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.399942 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:40.399942 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.399942 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:40.402172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.402544 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:40.402931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:40.402931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.403840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:40.403840 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.403840 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:40.403840 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.403840 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.403840 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:40.403840 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.403840 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:40.405245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.405595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:40.406970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.407311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.407714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:40.407714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.407714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:40.432348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:40.433056 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:40.434208 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:40.434533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.435327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:46:40.435327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.435327 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:40.435327 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.435327 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.435327 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:40.435327 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.435327 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:40.436800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.437516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:40.438601 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.439092 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:40.439765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.439765 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:40.440460 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:40.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:40.441633 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:40.441932 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:40.442211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.442804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:46:40.442804 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.442804 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:40.442804 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.442804 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.442804 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:40.442804 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.442804 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.444048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:40.444508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:44.938866 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:44.940361 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:44.971642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:44.972105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:44.973064 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:44.973064 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:44.973064 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:44.973064 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:44.973064 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:44.973064 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:44.973064 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:44.973064 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:44.974003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:44.975158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:45.395267 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:45.396383 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:45.397423 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:45.398022 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:45.398348 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:45.398585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.399582 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:45.399582 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.399582 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:45.399582 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.399582 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.399582 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:45.399582 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.399582 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:45.401706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.402186 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:45.402684 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:45.402684 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.403437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:45.403437 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.403437 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:45.403437 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.403437 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.403437 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:45.403437 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.403437 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:45.405135 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.405645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:45.407550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.407947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.408301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:45.408301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.408301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:45.432945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:45.433586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:45.434326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:45.434944 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.435892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:46:45.435892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.435892 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:45.435892 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.435892 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.435892 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:45.435892 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.435892 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:45.437174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.437842 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:45.438949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.439804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:45.440683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.440683 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:45.440920 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:45.441284 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:45.441559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:45.441843 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:45.441927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.442422 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:46:45.442422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.442422 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:45.442422 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.442422 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.442422 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:45.442422 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.442422 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.443502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:45.444008 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:49.939608 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:49.941371 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:49.975298 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:49.975530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:49.976222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:49.976222 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:49.976222 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:49.976222 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:49.976222 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:49.976222 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:49.976222 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:49.976222 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:49.977206 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:49.977868 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:50.396223 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:50.398362 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:50.398878 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:50.399276 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:50.399569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.400318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:50.400834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:50.400834 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.400834 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:50.400834 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.400834 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.400834 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:50.400834 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.400834 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:50.402270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.402876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:50.403444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:50.403444 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.403733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:50.403733 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.403733 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:50.403733 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.403733 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.403733 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:50.403733 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.403733 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:50.404662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.405203 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:50.405955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.406479 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.407096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:50.407096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.407096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:50.433751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:50.434178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:50.435183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:50.435731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.436812 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:46:50.436812 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.436812 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:50.436812 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.436812 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.436812 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:50.436812 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.436812 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:50.437961 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.438699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:50.439509 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.440061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:50.440553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.440553 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:50.441407 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:50.441959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:50.442558 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:50.442971 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:50.443235 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.444124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:46:50.444124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.444124 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:50.444124 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.444124 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.444124 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:50.444124 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.444124 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.445323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:50.445860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:54.940472 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:54.944496 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:54.975636 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:54.976167 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:54.976993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:54.976993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:54.976993 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:54.976993 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:54.976993 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:54.976993 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:54.976993 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:54.976993 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:54.977917 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:54.978461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:55.397053 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:55.398427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:55.398975 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:55.399070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.400126 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:46:55.400126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.400126 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:55.400126 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.400126 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.400126 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:55.400126 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.400126 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:55.402320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.402902 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:55.403444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:55.403444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:46:55.403444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:55.403738 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.404388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:46:55.404388 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.404388 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:55.404388 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.404388 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.404388 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:55.404388 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.404388 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:55.405340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.406311 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:46:55.406648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.407302 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.408033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:55.408033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.408033 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:55.434478 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:55.434893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:55.435528 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:55.435971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.436978 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:46:55.436978 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.436978 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:55.436978 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.436978 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.436978 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:55.436978 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.436978 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:46:55.438427 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.439993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:46:55.440406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.441059 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:55.441700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.441700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:55.441904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:55.442627 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:55.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:55.443574 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:55.443935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.444911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:46:55.444911 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.444911 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:55.444911 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.444911 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.444911 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:55.444911 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.444911 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.446233 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:55.446832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:46:59.941072 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:46:59.942543 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:46:59.987492 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:46:59.987922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:59.989048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:46:59.989048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:59.989048 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:46:59.989048 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:46:59.989048 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:59.989048 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:46:59.989048 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:59.989048 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:59.990929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:46:59.992087 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:00.397847 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:00.399494 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:00.399959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:00.400226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.401549 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:00.401549 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.401549 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:00.401549 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.401549 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.401549 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:00.401549 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.401549 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:00.403708 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.404658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:00.405606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:00.405606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:00.405762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:00.406035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.406857 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:00.406857 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.406857 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:00.406857 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.406857 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.406857 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:00.406857 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.406857 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:00.407867 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.408481 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:00.408909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.409980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:00.409980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.409980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:00.435115 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:00.435594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:00.436641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:00.437222 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.438547 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:00.438547 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.438547 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:00.438547 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.438547 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.438547 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:00.438547 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.438547 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:00.440230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.440931 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:00.441998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.442817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:00.443667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.443667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:00.443667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:00.443667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:00.443667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:00.443667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:00.443667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.444406 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:00.444406 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.444406 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:00.444406 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.444406 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.444406 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:00.444406 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.444406 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.446275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:00.446921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:04.941810 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:04.943483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:04.984687 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:04.984994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:04.986342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:04.986342 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:04.986342 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:04.986342 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:04.986342 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:04.986342 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:04.986342 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:04.986342 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:04.986999 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:04.987977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:05.398447 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:05.399436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:05.399730 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:05.399907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.400550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:05.400550 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.400550 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:05.400550 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.400550 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.400550 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:05.400550 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.400550 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:05.401912 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.402536 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:05.404593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:05.405149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:05.405806 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:05.405806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.406374 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:05.406374 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.406374 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:05.406374 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.406374 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.406374 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:05.406374 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.406374 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:05.408174 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.408696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:05.410254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.410796 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.411385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:05.411385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.411385 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:05.435651 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:05.436131 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:05.436773 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:05.436920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.437550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:05.437550 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.437550 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:05.437550 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.437550 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.437550 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:05.437550 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.437550 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:05.438943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.439939 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:05.440431 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.441670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:05.443261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.443261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:05.443261 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:05.443462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:05.444229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:05.444566 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:05.444828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.445632 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:05.445632 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.445632 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:05.445632 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.445632 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.445632 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:05.445632 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.445632 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.447018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:05.447534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:09.942807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:09.944352 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:09.988879 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:09.989304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:09.990370 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:09.990370 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:09.990370 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:09.990370 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:09.990370 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:09.990370 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:09.990370 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:09.990370 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:09.991920 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:09.993132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:10.399170 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:10.400239 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:10.400476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:10.400639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.401530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:10.401530 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.401530 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:10.401530 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.401530 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.401530 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:10.401530 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.401530 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:10.404016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.404918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:10.405956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:10.405956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:10.405956 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:10.405956 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.406487 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:10.406487 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.406487 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:10.406487 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.406487 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.406487 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:10.406487 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.406487 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:10.407360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:10.408457 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:10.409560 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.410599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:10.436159 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:10.436543 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:10.437057 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:10.437414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.438287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:10.438287 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.438287 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:10.438287 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.438287 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.438287 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:10.438287 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.438287 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:10.439733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.440458 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:10.441344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.442278 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:10.443346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.443346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:10.443346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:10.444264 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:10.444869 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:10.445229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:10.445552 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.446501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:10.446501 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.446501 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:10.446501 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.446501 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.446501 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:10.446501 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.446501 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.448593 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:10.449175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:14.943449 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:14.944977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:14.982473 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:14.982795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:14.983809 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:14.983809 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:14.983809 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:14.983809 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:14.983809 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:14.983809 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:14.983809 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:14.983809 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:14.984905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:14.985532 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:15.399987 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:15.401072 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:15.401479 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:15.401764 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.402419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:15.402419 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.402419 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:15.402419 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.402419 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.402419 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:15.402419 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.402419 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:15.403621 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.404098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:15.405291 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:15.405790 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:15.406160 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:15.406383 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.407017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:15.407017 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.407017 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:15.407017 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.407017 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.407017 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:15.407017 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.407017 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:15.408366 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.408810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:15.410000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.410538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.411062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:15.411062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.411062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:15.436689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:15.437149 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:15.437788 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:15.438224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.439106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:15.439106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.439106 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:15.439106 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.439106 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.439106 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:15.439106 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.439106 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:15.440476 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.441312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:15.442200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.443026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:15.443795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.443795 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:15.443795 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:15.444230 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:15.444757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:15.445064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:15.445260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.445803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:15.445803 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.445803 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:15.445803 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.445803 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.445803 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:15.445803 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.445803 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.446927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:15.447345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:19.944140 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:19.946047 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:19.963306 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=240 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:47:19.983580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:19.984171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:19.985146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:19.985146 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:19.985146 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:19.985146 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:19.985146 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:19.985146 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:19.985146 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:19.985146 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:19.986039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:19.986833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:20.400543 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:20.401921 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:20.402200 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:20.402443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.403324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:20.403324 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.403324 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:20.403324 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.403324 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.403324 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:20.403324 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.403324 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:20.405158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.406037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:20.406799 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:20.406799 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:20.406799 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:20.406988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.407647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:20.407647 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.407647 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:20.407647 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.407647 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.407647 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:20.407647 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.407647 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:20.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:20.409946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:20.410611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.412166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:20.437497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:20.438058 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:20.439148 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:20.439745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.440371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:20.440371 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.440371 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:20.440371 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.440371 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.440371 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:20.440371 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.440371 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:20.441204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.441897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:20.442279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.443001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:20.443997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.443997 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:20.444103 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:20.444630 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:20.445176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:20.445428 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:20.445598 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.446253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:20.446253 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.446253 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:20.446253 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.446253 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.446253 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:20.446253 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.446253 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.447304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:20.447905 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:24.944858 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:24.946588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:24.986086 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:24.986387 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:24.987516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:24.987516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:24.987516 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:24.987516 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:24.987516 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:24.987516 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:24.987516 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:24.987516 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:24.988975 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:24.990027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:25.401203 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:25.402487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:25.402822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:25.403136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.404400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:25.404400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.404400 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:25.404400 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.404400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.404400 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:25.404400 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.404400 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:25.406436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.407184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:25.408138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:25.408138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:25.408138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:25.408138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.408942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:25.408942 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.408942 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:25.408942 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.408942 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.408942 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:25.408942 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.408942 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:25.410744 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.411224 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:25.413097 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.413590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.414149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:25.414149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.414149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:25.438125 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:25.438518 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:25.439228 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:25.439564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.440436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:25.440436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.440436 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:25.440436 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.440436 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.440436 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:25.440436 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.440436 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:25.441440 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.441924 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:25.442714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.443190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:25.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:25.444444 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:25.445310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:25.445720 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:25.445954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:25.446100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.446811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:25.446811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.446811 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:25.446811 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.446811 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.446811 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:25.446811 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.446811 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.448595 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:25.449653 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:29.945683 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:29.947951 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:29.985874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:29.986361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:29.987365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:29.987365 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:29.987365 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:29.987365 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:29.987365 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:29.987365 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:29.987365 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:29.987365 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:29.988511 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:29.989351 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:30.401826 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:30.403229 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:30.403654 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:30.403793 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.404799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:30.404799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.404799 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:30.404799 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.404799 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.404799 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:30.404799 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.404799 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:30.407124 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.407934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:30.408822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:30.408822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:30.408822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:30.408822 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.409558 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:30.409558 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.409558 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:30.409558 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.409558 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.409558 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:30.409558 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.409558 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:30.410950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.411973 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:30.412564 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.413421 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.414105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:30.414105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.414105 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:30.438598 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:30.438951 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:30.439482 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:30.439923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.440762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:30.440762 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.440762 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:30.440762 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.440762 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.440762 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:30.440762 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.440762 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:30.442027 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.442810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:30.443638 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.444434 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:30.445334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.445334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:30.445334 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:30.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:30.446322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:30.446710 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:30.446950 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.447745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:30.447745 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.447745 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:30.447745 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.447745 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.447745 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:30.447745 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.447745 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.449700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:30.450538 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:34.946913 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:34.950528 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:34.986897 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:34.987305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:34.988300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:34.988300 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:34.988300 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:34.988300 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:34.988300 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:34.988300 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:34.988300 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:34.988300 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:34.989480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:34.990574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:35.402482 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:35.403729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:35.404037 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:35.404283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.405280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:35.405280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.405280 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:35.405280 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.405280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.405280 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:35.405280 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.405280 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:35.406499 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.407501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:35.408408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:35.408408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:35.408408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:35.408661 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.409179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:35.409179 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.409179 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:35.409179 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.409179 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.409179 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:35.409179 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.409179 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:35.409837 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:35.410768 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:35.411494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.412563 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:35.439201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:35.439662 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:35.440238 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:35.440755 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.442013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:35.442013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.442013 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:35.442013 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.442013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.442013 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:35.442013 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.442013 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:35.443289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.444218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:35.445211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.446000 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:35.446993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.446993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:35.446993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:35.446993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:35.446993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:35.446993 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:35.447207 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.447918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:35.447918 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.447918 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:35.447918 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.447918 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.447918 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:35.447918 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.447918 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.449732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:35.450240 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:39.947641 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:39.948942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:39.989883 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:39.990341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:39.991345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:39.991345 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:39.991345 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:39.991345 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:39.991345 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:39.991345 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:39.991345 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:39.991345 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:39.992342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:39.993437 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:40.403275 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:40.404900 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:40.405358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:40.405628 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.406947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:40.406947 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.406947 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:40.406947 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.406947 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.406947 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:40.406947 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.406947 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:40.408990 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.409520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:40.410098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:40.410098 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:40.410363 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:40.410726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.411382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:40.411382 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.411382 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:40.411382 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.411382 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.411382 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:40.411382 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.411382 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:40.412554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.413075 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:40.413934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.414401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.414957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:40.414957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.414957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:40.439649 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:40.440300 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:40.441068 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:40.441498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.442710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:40.442710 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.442710 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:40.442710 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.442710 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.442710 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:40.442710 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.442710 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:40.444152 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.445192 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:40.445724 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.446657 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:40.447600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.447600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:40.447600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:40.447600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:40.447600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:40.447600 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:40.447600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.448243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:40.448243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.448243 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:40.448243 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.448243 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.448243 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:40.448243 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.448243 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.450084 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:40.450548 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:44.948186 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:44.949790 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:44.986221 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:44.986645 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:44.987578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:44.987578 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:44.987578 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:44.987578 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:44.987578 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:44.987578 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:44.987578 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:44.987578 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:44.988829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:44.989786 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:45.404177 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:45.405692 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:45.406001 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:45.406225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.407257 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:45.407257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.407257 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:45.407257 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.407257 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.407257 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:45.407257 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.407257 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:45.409316 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.410138 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:45.411034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:45.411034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:45.411034 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:45.411034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.411447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:45.411447 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.411447 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:45.411447 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.411447 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.411447 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:45.411447 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.411447 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:45.412357 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.413170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:45.413606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.414361 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.414965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:45.414965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.414965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:45.440310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:45.440808 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:45.441374 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:45.441851 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.442641 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:45.442641 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.442641 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:45.442641 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.442641 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.442641 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:45.442641 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.442641 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:45.443732 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.444216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:45.445371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.445891 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:45.446543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.446543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:45.446649 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:45.447256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:45.447762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:45.448107 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:45.448489 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.449273 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:45.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:45.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.449273 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:45.449273 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.449273 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.451200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:45.451709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:49.949270 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:49.951178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:49.988448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:49.988876 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:49.989862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:49.989862 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:49.989862 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:49.989862 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:49.989862 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:49.989862 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:49.989862 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:49.989862 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:49.991151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:49.992146 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:50.405045 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:50.406292 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:50.406768 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:50.407114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.408212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:50.408212 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.408212 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:50.408212 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.408212 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.408212 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:50.408212 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.408212 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:50.410443 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.411362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:50.412526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:50.412526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:50.412526 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:50.412897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.413592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:50.413592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.413592 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:50.413592 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.413592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.413592 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:50.413592 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.413592 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:50.415024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.415520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:50.416806 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.417289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.418019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:50.418019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.418019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:50.440922 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:50.441282 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:50.441876 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:50.442305 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.443101 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:50.443101 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.443101 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:50.443101 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.443101 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.443101 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:50.443101 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.443101 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:50.443988 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.444672 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:50.445496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.446350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:50.447153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.447153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:50.447481 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:50.448421 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:50.448950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:50.449484 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:50.449810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.450698 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:50.450698 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.450698 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:50.450698 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.450698 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.450698 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:50.450698 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.450698 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.451829 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:50.452820 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:54.950265 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:54.951911 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:54.984259 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:54.984700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:54.985589 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:54.985589 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:54.985589 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:54.985589 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:54.985589 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:54.985589 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:54.985589 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:54.985589 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:54.986890 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:54.987927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:55.405761 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:55.407053 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:55.407448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:55.407714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.408652 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:47:55.408652 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.408652 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:55.408652 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.408652 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.408652 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:55.408652 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.408652 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:55.409935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.411210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:55.412079 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:55.412079 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:47:55.412215 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:55.412485 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.413239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:47:55.413239 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.413239 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:55.413239 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.413239 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.413239 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:55.413239 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.413239 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:55.414567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.415362 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:47:55.416594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.417153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.417733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:55.417733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.417733 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:55.441555 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:55.442129 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:55.442653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:55.442972 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.443804 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:47:55.443804 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.443804 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:55.443804 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.443804 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.443804 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:55.443804 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.443804 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:47:55.444994 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.445833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:47:55.447229 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.448026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:55.448859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.448859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:55.448859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:55.448859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:55.448859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:55.448859 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:55.448859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.449317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:47:55.449317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.449317 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:55.449317 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.449317 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.449317 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:55.449317 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.449317 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.450647 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:55.451292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:47:59.951120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:47:59.952408 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:47:59.987812 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:47:59.988259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:59.989217 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:47:59.989217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:59.989217 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:47:59.989217 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:47:59.989217 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:59.989217 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:47:59.989217 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:59.989217 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:59.990811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:47:59.991414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:00.406410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:00.407693 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:00.407942 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:00.408198 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.409160 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:00.409160 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.409160 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:00.409160 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.409160 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.409160 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:00.409160 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.409160 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:00.411060 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.411830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:00.412639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:00.412639 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:00.412933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:00.413276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.414086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:48:00.414086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.414086 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:00.414086 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.414086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.414086 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:00.414086 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.414086 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:00.414992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.415792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:00.416223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.417172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.418310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:00.418310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.418310 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:00.442191 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:00.442656 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:00.443185 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:00.443588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.444382 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:00.444382 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.444382 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:00.444382 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.444382 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.444382 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:00.444382 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.444382 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:00.445264 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.445748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:00.446388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.446877 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:00.447456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.447456 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:00.448311 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:00.448863 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:00.449243 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:00.449667 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:00.450018 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.450798 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:00.450798 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.450798 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:00.450798 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.450798 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.450798 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:00.450798 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.450798 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.452624 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:00.453096 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:04.951559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:04.953410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:04.992179 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:04.992432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:04.993184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:04.993184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:04.993184 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:04.993184 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:04.993184 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:04.993184 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:04.993184 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:04.993184 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:04.994878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:04.995737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:05.407007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:05.407981 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:05.408281 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:05.408522 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:05.409419 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.409419 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:05.409419 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.409419 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.409419 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:05.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.409419 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:05.410498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.410982 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:05.412203 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:05.412977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:05.413388 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:05.413569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.414175 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:48:05.414175 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.414175 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:05.414175 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.414175 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.414175 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:05.414175 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.414175 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:05.415569 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.415969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:05.417329 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.417873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.418359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:05.418359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.418359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:05.442896 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:05.443392 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:05.443937 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:05.444352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.445149 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:05.445149 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.445149 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:05.445149 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.445149 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.445149 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:05.445149 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.445149 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:05.445957 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.446662 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:05.447080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.447828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:05.448714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.448714 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:05.448714 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:05.449253 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:05.449762 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:05.450120 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:05.450353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.451223 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:05.451223 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.451223 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:05.451223 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.451223 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.451223 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:05.451223 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.451223 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.453039 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:05.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:09.952241 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:09.953992 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:09.986032 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:09.986368 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:09.987188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:09.987188 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:09.987188 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:09.987188 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:09.987188 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:09.987188 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:09.987188 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:09.987188 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:09.988007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:09.988855 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:10.407676 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:10.408905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:10.409250 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:10.409502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.410664 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:10.410664 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.410664 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:10.410664 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.410664 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.410664 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:10.410664 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.410664 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:10.412801 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.413710 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:10.414827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:10.414827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:10.414827 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:10.414827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.415731 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:48:10.415731 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.415731 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:10.415731 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.415731 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.415731 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:10.415731 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.415731 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:10.417058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.418119 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:10.418797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.419518 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.420367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:10.420367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.420367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:10.443651 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:10.444178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:10.444711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:10.445052 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.445910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:10.445910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.445910 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:10.445910 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.445910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.445910 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:10.445910 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.445910 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:10.447171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.447929 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:10.448871 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.449592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:10.450505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.450505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:10.450505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:10.450505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:10.450505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:10.450874 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:10.450937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.451718 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:10.451718 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.451718 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:10.451718 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.451718 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.451718 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:10.451718 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.451718 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.453494 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:10.454545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:14.953008 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:14.954933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:14.982344 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:14.982745 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:14.983588 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:14.983588 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:14.983588 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:14.983588 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:14.983588 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:14.983588 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:14.983588 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:14.983588 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:14.984527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:14.985320 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:15.408271 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:15.409519 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:15.409994 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:15.410317 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.411449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:15.411449 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.411449 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:15.411449 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.411449 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.411449 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:15.411449 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.411449 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:15.412709 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.413520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:15.414394 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:15.414462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:15.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:15.415156 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.415840 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:48:15.415840 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.415840 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:15.415840 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.415840 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.415840 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:15.415840 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.415840 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:15.417334 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.417863 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:15.419050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.419520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.420061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:15.420061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.420061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:15.444129 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:15.444501 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:15.444833 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:15.445063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.445533 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:15.445533 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.445533 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:15.445533 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.445533 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.445533 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:15.445533 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.445533 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:15.446284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.446759 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:15.447592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.448070 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:15.448892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.448892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:15.449689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:15.450247 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:15.450588 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:15.450861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:15.451044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.451554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:15.451554 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.451554 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:15.451554 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.451554 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.451554 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:15.451554 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.451554 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.452800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:15.453284 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:19.953835 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:19.955800 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:19.971959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=244 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:48:19.990222 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:19.990659 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:19.991592 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:19.991592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:19.991592 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:19.991592 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:19.991592 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:19.991592 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:19.991592 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:19.991592 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:19.992365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:19.993188 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:20.408989 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:20.410499 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:20.410955 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:20.411212 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.412365 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:20.412365 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.412365 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:20.412365 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.412365 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.412365 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:20.412365 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.412365 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:20.414253 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.414749 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:20.415590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:20.415590 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:20.416059 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:20.416346 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.417433 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:48:20.417433 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.417433 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:20.417433 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.417433 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.417433 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:20.417433 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.417433 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:20.418906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.419799 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:20.420642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.421426 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.422341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:20.422341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.422341 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:20.444706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:20.445199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:20.445630 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:20.445993 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.446729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:20.446729 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.446729 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:20.446729 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.446729 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.446729 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:20.446729 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.446729 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:20.448015 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.448742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:20.449792 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.450594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:20.451313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.451313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:20.451313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:20.451313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:20.451313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:20.451313 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:20.451313 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.451918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:20.451918 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.451918 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:20.451918 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.451918 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.451918 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:20.451918 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.451918 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.453568 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:20.454071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:24.954493 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:24.956157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:25.003943 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:25.005263 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.006200 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:25.409724 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:25.411213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:25.411585 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:25.411884 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.412910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:48:25.412910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.412910 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:25.412910 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.412910 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.412910 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:25.412910 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.412910 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:25.414954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.415803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:25.416959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:25.416959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:25.416959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:25.416959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.419226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.420288 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:25.421127 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.422026 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.422966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:25.422966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.422966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:25.445286 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:25.445708 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:25.446148 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:25.446513 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.447117 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:25.447117 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.447117 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:25.447117 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.447117 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.447117 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:25.447117 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.447117 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:25.448029 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.448766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:25.449171 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.449955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:25.451436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.451436 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:25.451436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:25.451436 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:25.451729 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:25.451850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:25.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.452643 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:25.452643 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.452643 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:25.452643 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.452643 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.452643 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:25.452643 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.452643 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.454336 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:25.458909 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:29.955065 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:29.956969 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:29.992046 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:29.992550 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:29.993461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:29.993461 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:29.993461 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:29.993461 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:29.993461 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:29.993461 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:29.993461 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:29.993461 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:29.994324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:29.995104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:30.410430 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:30.411694 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:30.412402 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:30.412402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.413013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:48:30.413013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.413013 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:30.413013 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.413013 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.413013 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:30.413013 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.413013 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:30.414350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.414922 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:30.415804 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:30.416343 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:30.417049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:30.417375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.418280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:30.418280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.418280 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:30.418280 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.418280 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.418280 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:30.418280 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.418280 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:30.419826 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.420805 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:30.421291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.421981 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.422751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:30.422751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.422751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:30.445988 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:30.446582 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:30.447360 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:30.447927 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.449021 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:30.449021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.449021 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:30.449021 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.449021 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.449021 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:30.449021 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.449021 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:30.450491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.451100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:30.452373 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:30.454218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.454218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:30.454218 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:30.454218 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:30.454218 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:30.454853 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:30.455125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.455986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:30.455986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.455986 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:30.455986 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.455986 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.455986 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:30.455986 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.455986 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.457331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:30.457834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:34.955771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:34.957309 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:34.992173 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:34.993578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:34.993784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:34.993784 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:34.993784 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:34.993784 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:34.993784 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:34.993784 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:34.993784 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:34.993784 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:34.994879 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:34.995789 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:35.411269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:35.412603 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:35.412916 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:35.413144 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.414043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:48:35.414043 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.414043 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:35.414043 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.414043 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.414043 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:35.414043 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.414043 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:35.415711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.416516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:35.418324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:35.418324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:35.418324 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:35.418324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.418687 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:35.418687 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.418687 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:35.418687 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.418687 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.418687 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:35.418687 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.418687 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:35.419445 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.420256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:35.420811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.421537 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.422367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:35.422367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.422367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:35.446740 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:35.447302 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:35.447902 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:35.448272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.449104 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:35.449104 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.449104 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:35.449104 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.449104 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.449104 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:35.449104 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.449104 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:35.450409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.451380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:35.452080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.453184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:35.454211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.454211 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:35.454211 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:35.454211 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:35.454505 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:35.454904 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:35.455151 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.455970 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:35.455970 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.455970 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:35.455970 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.455970 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.455970 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:35.455970 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.455970 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.457729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:35.458166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:39.956546 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:39.957809 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:39.989856 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:39.990296 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:39.991339 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:39.991339 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:39.991339 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:39.991339 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:39.991339 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:39.991339 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:39.991339 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:39.991339 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:39.992281 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:39.993226 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:40.411873 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:40.413206 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:40.413582 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:40.413992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.415088 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:48:40.415088 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.415088 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:40.415088 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.415088 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.415088 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:40.415088 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.415088 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:40.416980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.417911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:40.419378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:40.419378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:40.419378 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:40.419378 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.420037 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:48:40.420037 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.420037 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:40.420037 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.420037 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.420037 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:40.420037 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.420037 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:40.421261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.421756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:40.423121 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.423570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.424081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:40.424081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.424081 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:40.447427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:40.447970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:40.448514 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:40.448966 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.449703 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:40.449703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.449703 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:40.449703 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.449703 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.449703 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:40.449703 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.449703 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:40.450565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.451524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:40.452047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.452815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:40.453701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.453701 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:40.454084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:40.454579 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:40.455062 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:40.455448 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:40.455752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.456502 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:40.456502 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.456502 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:40.456502 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.456502 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.456502 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:40.456502 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.456502 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.457391 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:40.457915 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:44.957224 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:44.958429 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:44.998263 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:44.998716 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:44.999751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:44.999751 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:44.999751 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:44.999751 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:44.999751 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:44.999751 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:44.999751 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:44.999751 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.000597 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.001648 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:45.412427 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:45.413418 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:45.413776 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:45.414050 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.414870 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:45.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:45.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.414870 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:45.414870 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.414870 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:45.416043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.417234 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:45.418210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:45.418210 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:45.418410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:45.418726 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.419309 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:48:45.419309 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.419309 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:45.419309 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.419309 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.419309 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:45.419309 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.419309 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:45.420183 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.420940 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:45.421251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.421766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.422324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:45.422324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.422324 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:45.447940 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:45.448418 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:45.448933 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:45.449360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.450102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:45.450102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.450102 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:45.450102 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.450102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.450102 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:45.450102 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.450102 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:45.450923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.451565 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:45.451992 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.452893 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:45.453697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.453697 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:45.454559 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:45.455269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:45.455807 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:45.456183 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:45.456496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.457409 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:45.457409 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.457409 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:45.457409 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.457409 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.457409 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:45.457409 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.457409 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.459371 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:45.460136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:49.959757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:49.960358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:50.005217 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:50.005423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.006125 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:50.006125 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.006125 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:50.006125 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.006125 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.006125 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:50.006125 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.006125 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.008003 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.008570 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:50.413017 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:50.413883 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:50.414080 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:50.414230 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.414810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:50.414810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.414810 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:50.414810 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.414810 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.414810 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:50.414810 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.414810 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:50.416172 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.416527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:50.418064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:50.418376 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:50.418681 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:50.418828 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.419435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:48:50.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:50.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:50.419435 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.419435 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:50.420591 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.420937 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:50.422164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.422515 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.422919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:50.422919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.422919 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:50.448726 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:50.449900 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:50.450586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:50.450670 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.451252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:50.451252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.451252 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:50.451252 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.451252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.451252 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:50.451252 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.451252 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:50.452210 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.452685 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:50.453319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.453897 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:50.454418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.454418 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:50.455503 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:50.455589 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:50.456013 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.457946 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:50.458469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:54.959653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:54.960466 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:54.993193 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:54.993524 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:54.994545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:54.994545 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:54.994545 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:54.994545 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:54.994545 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:54.994545 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:54.994545 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:54.994545 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:54.995557 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:54.996461 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:55.413511 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:55.414674 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.417642 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:55.418093 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.418594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:55.419123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:55.419123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:48:55.419123 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:55.419833 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.420407 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:48:55.420407 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.420407 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:55.420407 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.420407 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.420407 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:55.420407 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.420407 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:55.421830 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:55.422954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:55.423996 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.425276 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:55.449441 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:55.450201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:55.450781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:55.451574 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.452545 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:48:55.452545 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.452545 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:55.452545 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.452545 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.452545 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:55.452545 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.452545 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:48:55.453289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.453734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:48:55.454777 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.456019 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:55.456567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.456567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:55.456567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:55.456567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:55.456567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:55.456567 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:55.456567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.457279 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:48:55.457279 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.457279 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:55.457279 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.457279 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.457279 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:55.457279 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.457279 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.458590 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:55.459911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:48:59.960219 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:48:59.961256 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:48:59.991080 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:48:59.991080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:59.991301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:48:59.991301 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:59.991301 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:48:59.991301 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:48:59.991301 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:59.991301 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:48:59.991301 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:59.991301 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:59.992259 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:48:59.992800 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:00.414227 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:00.416304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:00.416304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:00.416304 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.416729 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:49:00.416729 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.416729 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:00.416729 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.416729 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.416729 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:00.416729 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.416729 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:00.421168 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.421911 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:00.422332 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:00.422332 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Traceback (most recent call last):
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:00.424340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.424693 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:00.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.425080 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-25c1b22f-416b-4ac9-8907-0fb820403d59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:00.425292 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.425658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.426030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:00.426030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.426030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:00.450104 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:00.450552 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:00.452189 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:00.452189 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.452318 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:00.452318 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.452318 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:00.452318 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.452318 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.452318 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:00.452318 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.452318 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:00.453137 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.453832 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:00.454256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.455063 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:00.455889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.455889 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:00.456665 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:00.457277 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:00.457854 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:00.458748 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:00.458949 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.459817 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:00.459817 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.459817 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:00.459817 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.459817 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.459817 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:00.459817 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.459817 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.460885 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:00.461254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:04.960822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:04.962099 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:04.993416 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:04.993968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:04.995030 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:04.995030 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:04.995030 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:04.995030 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:04.995030 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:04.995030 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:04.995030 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:04.995030 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:04.996179 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:04.997143 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:05.415038 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:05.415857 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:05.416097 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:05.416356 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.417878 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:05.417878 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.417878 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:05.417878 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.417878 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.417878 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:05.417878 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.417878 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:05.418308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.418823 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:05.421713 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:05.422234 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:05.422756 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:05.423007 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.423704 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:05.423704 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.423704 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:05.423704 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.423704 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.423704 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:05.423704 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.423704 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:05.424599 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.425114 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:05.425691 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.426270 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.426910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:05.426910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.426910 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:05.450587 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:05.451383 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:05.451977 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:05.452773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.453400 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:05.453400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.453400 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:05.453400 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.453400 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.453400 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:05.453400 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.453400 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:05.454543 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.455459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:05.456415 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.457581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:05.458340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.458340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:05.458340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:05.458340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:05.458340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:05.458340 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:05.458340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.458340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:05.458597 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.458597 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:05.458597 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.458597 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.458597 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:05.458597 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.458597 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.459216 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:05.459737 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:09.961453 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:09.963074 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:09.997102 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:09.997380 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:09.998162 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:09.998162 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:09.998162 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:09.998162 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:09.998162 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:09.998162 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:09.998162 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:09.998162 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:09.999077 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:09.999690 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:10.415653 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:10.416816 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:10.417084 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:10.417308 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.418348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:10.418348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.418348 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:10.418348 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.418348 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.418348 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:10.418348 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.418348 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:10.420291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.421043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:10.422109 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:10.422565 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:10.422875 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:10.423065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.423521 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:10.423521 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.423521 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:10.423521 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.423521 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.423521 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:10.423521 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.423521 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:10.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.424788 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:10.425255 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.425722 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.426348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:10.426348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.426348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:10.451202 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:10.451628 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:10.452092 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:10.452359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.453102 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:10.453102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.453102 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:10.453102 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.453102 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.453102 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:10.453102 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.453102 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:10.453998 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.454430 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:10.455054 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.455501 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:10.456106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.456106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:10.457231 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:10.457777 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:10.458157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:10.458523 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:10.458947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.460044 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:10.460044 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.460044 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:10.460044 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.460044 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.460044 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:10.460044 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.460044 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.461770 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:10.462272 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:14.962163 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:14.963225 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:14.997326 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:14.997491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:14.997901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:14.997901 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:14.997901 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:14.997901 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:14.997901 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:14.997901 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:14.997901 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:14.997901 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:14.998711 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:14.999473 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:15.416164 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:15.417347 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:15.417574 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:15.417756 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.418493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:15.418493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.418493 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:15.418493 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.418493 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.418493 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:15.418493 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.418493 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:15.419802 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.420360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:15.422426 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:15.422781 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:15.423103 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:15.423353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.424239 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:15.424239 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.424239 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:15.424239 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.424239 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.424239 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:15.424239 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.424239 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:15.426873 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:15.427892 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:15.428642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.429516 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:15.451659 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:15.452176 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:15.452533 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:15.453085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.453585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:15.453585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.453585 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:15.453585 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.453585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.453585 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:15.453585 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.453585 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:15.454815 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.455498 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:15.456414 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.456935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:15.457442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.457442 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:15.457645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:15.458368 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:15.458885 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:15.459226 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:15.459447 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.460252 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:15.460252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.460252 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:15.460252 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.460252 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.460252 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:15.460252 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.460252 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.462184 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:15.462785 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:19.962778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:19.964369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:19.977965 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG dbcounter [-] [104932] Writing DB stats neutron:SELECT=236 {{(pid=104932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 08 13:49:19.996358 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:19.997071 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:19.997947 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:19.997947 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:19.997947 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:19.997947 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:19.997947 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:19.997947 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:19.997947 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:19.997947 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:19.999058 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:19.999995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:20.416830 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:20.418007 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:20.418286 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:20.418520 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.419435 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:20.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:20.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.419435 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:20.419435 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.419435 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:20.421508 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.422352 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:20.423236 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:20.423410 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:20.424154 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:20.424527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.425411 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:20.425411 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.425411 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:20.425411 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.425411 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.425411 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:20.425411 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.425411 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:20.426813 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.427794 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:20.428449 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.429388 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.430300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:20.430300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.430300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:20.452089 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:20.452594 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:20.453128 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:20.453611 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.454424 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:20.454424 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.454424 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:20.454424 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.454424 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.454424 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:20.454424 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.454424 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:20.455331 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.456083 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:20.456469 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.457261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:20.458154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.458154 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:20.458325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:20.458711 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:20.459087 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:20.459346 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:20.459606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.460140 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:20.460140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.460140 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:20.460140 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.460140 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.460140 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:20.460140 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.460140 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.461190 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:20.462344 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:24.963449 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:24.965128 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:24.998504 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:24.998951 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:24.999923 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:24.999923 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:24.999923 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:24.999923 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:24.999923 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:24.999923 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:24.999923 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:24.999923 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.001244 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.002056 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:25.417451 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:25.418487 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:25.418705 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:25.418859 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.419700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:25.419700 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.419700 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:25.419700 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.419700 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.419700 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:25.419700 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.419700 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:25.421402 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.422534 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:25.423905 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:25.424011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:25.424443 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:25.424651 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.425209 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:25.425209 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.425209 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:25.425209 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.425209 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.425209 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:25.425209 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.425209 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:25.427148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.427766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:25.428512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.428969 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.429459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:25.429459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.429459 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:25.452597 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:25.453237 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:25.453751 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:25.453977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.454575 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:25.454575 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.454575 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:25.454575 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.454575 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.454575 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:25.454575 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.454575 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:25.455963 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.456740 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:25.457642 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.458236 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:25.458901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.458901 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:25.458901 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:25.459642 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:25.460105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:25.460322 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:25.460471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.461086 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:25.461086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.461086 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:25.461086 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.461086 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.461086 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:25.461086 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.461086 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.462464 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:25.463155 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:29.964053 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:29.965321 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:30.001704 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:30.002016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.002781 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:30.002781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.002781 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:30.002781 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.002781 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.002781 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:30.002781 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.002781 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.003907 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.004493 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:30.418021 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:30.419090 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:30.419254 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:30.419364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.420016 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:30.420016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.420016 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:30.420016 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.420016 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.420016 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:30.420016 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.420016 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:30.421148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.422013 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:30.423893 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:30.424551 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:30.425049 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:30.425254 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.425881 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:30.425881 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.425881 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:30.425881 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.425881 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.425881 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:30.425881 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.425881 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:30.427364 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.427986 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:30.429094 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.429655 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.430232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:30.430232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.430232 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:30.453138 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:30.453931 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:30.454766 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:30.455170 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.455968 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:30.455968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.455968 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:30.455968 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.455968 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.455968 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:30.455968 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.455968 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:30.456952 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.457747 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:30.458161 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.458903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:30.459748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.459748 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:30.459748 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:30.459748 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:30.460165 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:30.460607 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:30.460948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.462062 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:30.462062 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.462062 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:30.462062 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.462062 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.462062 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:30.462062 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.462062 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.463810 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:30.464658 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:34.964757 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:34.966441 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:35.005522 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:35.006218 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.006677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:35.006677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.006677 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:35.006677 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.006677 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.006677 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:35.006677 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.006677 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.007735 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.008605 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:35.418607 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:35.419907 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:35.420247 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:35.420492 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.421423 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:35.421423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.421423 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:35.421423 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.421423 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.421423 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:35.421423 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.421423 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:35.422600 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.423678 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:35.424666 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:35.424963 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:35.425450 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:35.425772 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.426488 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:35.426488 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.426488 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:35.426488 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.426488 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.426488 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:35.426488 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.426488 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:35.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.428594 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:35.429291 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.430301 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.431325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:35.431325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.431325 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:35.453796 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:35.454141 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:35.454586 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:35.455034 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.455834 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:35.455834 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.455834 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:35.455834 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.455834 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.455834 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:35.455834 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.455834 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:35.456573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.457269 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:35.457700 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.458466 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:35.459342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.459342 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:35.459870 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:35.460310 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:35.460691 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:35.461055 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:35.461280 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.461974 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:35.461974 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.461974 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:35.461974 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.461974 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.461974 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:35.461974 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.461974 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.463004 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:35.463583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:39.965318 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:39.967011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:39.999314 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:39.999734 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.000404 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:40.000404 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.000404 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:40.000404 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.000404 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.000404 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:40.000404 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.000404 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.001392 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.002225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:40.419285 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:40.420645 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:40.421064 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:40.421323 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.422275 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:40.422275 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.422275 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:40.422275 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.422275 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.422275 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:40.422275 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.422275 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:40.424512 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.427043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.427784 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:40.428679 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:40.429300 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.429719 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.430204 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:40.454385 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:40.455038 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:40.455573 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:40.456047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.456860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:40.456860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.456860 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:40.456860 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.456860 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.456860 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:40.456860 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.456860 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:40.458372 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.459510 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:40.461340 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.461847 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:40.462312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.462312 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:40.462312 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:40.462404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:40.462998 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:40.463369 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:40.463606 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.464527 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:40.464527 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.464527 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:40.464527 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.464527 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.464527 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:40.464527 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.464527 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.466290 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:40.466852 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:44.966011 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:44.967593 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:44.998465 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:44.998955 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:44.999959 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:44.999959 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:44.999959 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:44.999959 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:44.999959 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:44.999959 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:44.999959 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:44.999959 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.001098 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.001995 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:45.419984 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:45.421476 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:45.421748 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:45.421935 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.422965 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:45.422965 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.422965 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:45.422965 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.422965 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.422965 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:45.422965 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.422965 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:45.425112 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.425976 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:45.426706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:45.426706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:45.426706 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:45.426706 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.427001 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:45.427001 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.427001 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:45.427001 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.427001 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.427001 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:45.427001 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.427001 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:45.428358 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.429085 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:45.430099 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.431327 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.432245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:45.432245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.432245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:45.454822 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:45.455213 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:45.455970 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:45.456353 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.457319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:45.457319 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.457319 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:45.457319 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.457319 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.457319 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:45.457319 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.457319 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:45.458529 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.459283 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:45.460193 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.461082 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:45.461761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.461761 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:45.462192 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:45.462959 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:45.463403 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:45.463689 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:45.463900 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.464531 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:45.464531 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.464531 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:45.464531 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.464531 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.464531 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:45.464531 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.464531 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.466106 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:45.466773 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:49.967093 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:49.968545 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:50.001228 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:50.001603 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.002432 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:50.002432 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.002432 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:50.002432 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.002432 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.002432 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:50.002432 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.002432 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.003578 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.004742 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:50.420744 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:50.421999 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:50.422335 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:50.422573 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.423639 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:50.423639 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.423639 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:50.423639 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.423639 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.423639 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:50.423639 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.423639 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:50.425471 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.426584 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:50.427386 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:50.427386 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:50.427386 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:50.427386 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.427752 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:50.427752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.427752 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:50.427752 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.427752 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.427752 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:50.427752 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.427752 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:50.428395 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:50.429319 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.430359 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.432261 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:50.455646 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:50.456475 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:50.456785 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.458061 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:50.459797 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.460287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:50.461024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.461675 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:50.463100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.463100 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:50.463100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:50.463199 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:50.463754 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:50.463856 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:50.463980 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.464585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:50.464585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.464585 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:50.464585 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.464585 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.464585 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:50.464585 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.464585 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.466348 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:50.466887 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:54.968075 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:54.969572 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:55.007709 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:55.008024 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.008838 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:49:55.008838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.008838 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:55.008838 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.008838 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.008838 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:55.008838 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.008838 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.010048 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.010954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:55.421128 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:55.422356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:55.422677 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:55.422918 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.423934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:49:55.423934 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.423934 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:55.423934 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.423934 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.423934 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:55.423934 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.423934 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:55.425677 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.426136 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:55.426606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:55.426606 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:49:55.426938 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:55.427132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:49:55.427728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.427728 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:55.427728 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.427728 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.427728 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:55.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.427728 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:55.429047 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.429491 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:49:55.430751 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.431225 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.431762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:55.431762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.431762 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:55.455987 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:55.456304 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:55.456945 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:55.457375 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.458286 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:49:55.458286 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.458286 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:55.458286 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.458286 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.458286 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:55.458286 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.458286 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:49:55.459839 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.460567 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:49:55.461403 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.462294 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:55.463178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.463178 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:55.463178 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:55.463570 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:49:55.464217 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:55.464577 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:49:55.464942 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.465862 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:49:55.465862 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.465862 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:49:55.465862 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.465862 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.465862 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:49:55.465862 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.465862 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.467043 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:49:55.468360 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:49:59.968818 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:49:59.970768 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:00.010497 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:00.011109 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.011844 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:50:00.011844 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.011844 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:00.011844 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.011844 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.011844 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:00.011844 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.011844 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.012766 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.013667 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:00.421797 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:00.422861 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:00.423201 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:00.423439 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:00.425199 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:00.425583 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.425971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:00.425971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.425971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.425971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:00.425971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.425971 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:00.426491 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:00.426771 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:50:00.427292 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:00.427581 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.429519 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.429948 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:50:00.430251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.430561 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.430903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:00.430903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.430903 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:00.456446 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:00.456925 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:00.457462 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:00.457977 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.458906 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:50:00.458906 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.458906 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:00.458906 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.458906 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.458906 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:00.458906 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.458906 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:50:00.460132 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.460453 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:50:00.461827 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.462166 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:00.462505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.462505 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:00.463307 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:00.464000 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:00.464404 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:00.464621 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:00.464791 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.465398 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:50:00.465398 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.465398 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:00.465398 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.465398 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.465398 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:00.465398 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.465398 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.467153 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:00.467495 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:04.969483 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:04.971197 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:05.003338 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:05.003860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.004696 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:50:05.004696 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.004696 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:05.004696 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.004696 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.004696 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:05.004696 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.004696 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.005571 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.006416 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:05.422745 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:05.423978 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:05.424294 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:05.424530 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.425525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:50:05.425525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.425525 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:05.425525 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.425525 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.425525 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:05.425525 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.425525 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:05.427480 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.428227 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:05.429121 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:05.429121 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:50:05.429121 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:05.429289 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.430274 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:50:05.430274 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.430274 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:05.430274 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.430274 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.430274 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:05.430274 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.430274 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:50:05.431954 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.432350 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:50:05.434539 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.435035 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.435525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:05.435525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.435525 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:05.456973 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:05.457364 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:05.457950 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:05.458243 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.459065 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:50:05.459065 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.459065 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:05.459065 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.459065 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.459065 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:05.459065 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.459065 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:50:05.460486 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.461164 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:50:05.467496 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.468381 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:05.469122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.469122 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:05.469257 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:05.473100 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:05.473747 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:05.474105 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:05.474367 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.475245 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:50:05.475245 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.475245 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:05.475245 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.475245 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.475245 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:05.475245 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.475245 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.476743 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:05.477562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:09.970249 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:09.972066 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:10.005157 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:10.005507 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.006251 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Traceback (most recent call last):
Apr 08 13:50:10.006251 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.006251 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:10.006251 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.006251 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.006251 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:10.006251 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.006251 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-5257fbb6-4c55-495c-88dd-7644d747c28c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.007345 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.008699 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:10.423425 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:10.424778 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-8a1f0bbb-fd6d-4ca7-8e06-c467454aa4dc, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:10.425069 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-71709845-924e-42fd-985e-d000e2c61286, routes=[], if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:10.425475 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.426256 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Traceback (most recent call last):
Apr 08 13:50:10.426256 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.426256 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:10.426256 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.426256 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.426256 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:10.426256 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.426256 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-3ee0ff83-b137-42ad-91f7-a6c6a47ec268 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:10.427562 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.428803 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:10.429850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:10.429850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Setting fip-distributed flag in NB_Global to False {{(pid=104932) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 08 13:50:10.429850 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:10.429850 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.431017 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Traceback (most recent call last):
Apr 08 13:50:10.431017 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.431017 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:10.431017 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.431017 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.431017 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:10.431017 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.431017 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:50:10.432158 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.432848 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-b00c246d-486f-4676-8835-af5a86c0ee9a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 08 13:50:10.433825 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.434811 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.435554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:10.435554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.435554 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:10.457356 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:10.457664 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:10.458325 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:10.458585 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.459287 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Traceback (most recent call last):
Apr 08 13:50:10.459287 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.459287 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:10.459287 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.459287 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.459287 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:10.459287 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.459287 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 08 13:50:10.460394 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.461390 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-8865ab4b-d6a2-46ff-abcf-d16d6fa91436 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 08 13:50:10.462228 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.463148 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:10.463934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.463934 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics 
Apr 08 13:50:10.470913 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104932) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 08 13:50:10.471555 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104932) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 08 13:50:10.472187 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:10.472580 np0000164309 neutron-ovn-maintenance-worker[104932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104932) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 08 13:50:10.472860 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.473921 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Traceback (most recent call last):
Apr 08 13:50:10.473921 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.473921 np0000164309 neutron-ovn-maintenance-worker[104932]:     txn.results.put(txn.do_commit())
Apr 08 13:50:10.473921 np0000164309 neutron-ovn-maintenance-worker[104932]:                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.473921 np0000164309 neutron-ovn-maintenance-worker[104932]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.473921 np0000164309 neutron-ovn-maintenance-worker[104932]:     raise RuntimeError(msg)
Apr 08 13:50:10.473921 np0000164309 neutron-ovn-maintenance-worker[104932]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.473921 np0000164309 neutron-ovn-maintenance-worker[104932]: 
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics [None req-afb319a9-3b11-4572-a13a-8cfd26335393 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics Traceback (most recent call last):
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     work()
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.475401 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     next(self.gen)
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     with self.create_transaction(
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     self.result = self.commit()
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise result.ex
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 08 13:50:10.476260 np0000164309 neutron-ovn-maintenance-worker[104932]: ERROR futurist.periodics